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I . INTRODUCTION 



N«lo„al attention 1, tocuaed on education, the quallt, o£ Instruction 
offered by tuachers. the effectiveness of the leadership of administrative 
and supervisor, staff, and the value of structures and progra.. advocated by 
■ schools, local education agencies (LEAs) , and state education agencies (SEAs), 
concerned professionals assess current efforts, and plan and l„ple.ent 
improvements in a variety of ways. 

• in Maryland, a statewide program with voluntary local participation 'was 
initiated in 1980. • This School Improvement Through Instructional Process 
(SHIP) program encourages application of research on planned change to 
implement one or more of four instructional models. The Maryland State 
Department of Education (MSDE) supports local implementation by providing 
"funds, training, and technical assistance. The SITIP design also includes 
evaluation, with a series of interim reports providing feedback on critical 
events so that improvements can be made when appropriate. 

Three n:ajor evaluation reports will have been written by the time 
direct involvement by MSDE comes to an end. The first (Roberts et al.. 
1982) focused on implementation for the period December 1980 to June 1982. 
The last. Which will cover the 1983-84 school year, will focus on 
institutionali^ation. This report, covering the 1982-83 school year, 
focuses on program impact. 

Following a brief overview of SHIP, the following areas are discussed: 
evaluation, state Initiatives and technical assistance, and local Implemen- 
tation and impact. The final chapter presents a su«ry and conclusions. 
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II. OVERVIEW OF MARYLAND'S SCHOOL IMPROVEMENT PROGRAM 

This chapter presents an overview of Maryland's school improvement 
program, outlines the four instructional models used in the program, and 
summarizes the results reported for the first 18 months-December 1980 to 
June 1982 (Roberts, et al., 1982). 

. The SITIP Design 
Maryland's School Improvement Through Instructional Process (SITIP) ' 
program involves education agencies (LEAs) in voluntarily implementing 
instructional processes pr. ven to be effective in increasing student achieve- 
ment. The instructional models used in SITIP are: Active Teaching. Mastery 
Learning, Student Team Learning, and Teaching Variables. All four models are 
research-based and were selected by the Maryland State Department of Education 
(MSDE) as potentially useful to all. schools for improving instruction in all 
structured academic curricula. During the 1981-82 school year, nearly 700 
teachers in grades K-12 used one or more of the models in mathematics, 
reading/language arts, science, social studies, or other academic areas. 

Preparation activities by MSDE began in mid 1980. The intention was to 
develop a program to help LEAs bring about instructional improvement, prefer- 
ably by using "proven practices." or research-based models of instruction, 
together with processes found to be effective in planned change and school 
improvement. The ultimate objective was to increase student achievement. 

SITIP was designed by MSDE as a multi-year program consisting of inter- 
active activities which are outlined below and presented in Figure 1. 

1. Preparation (open systems planning); Identify needs and potential 
solutions. Identify operating constraints and opportunities 
particularly existing programs or policies that could form a 'basis 
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HSDE Preparation 
(open-systems planning) 



Initial Conifiitment 
(of local teams) 



Awareness Conferences 
(concent and desif^n 
informauon) 



Technical Assistance 
(coaching) 



Local Proposals and Plans 
(with allowance for biannual 
or annual up-dates) 



Follow-up Training 



— ^ 



Implementation 



Assesstneiu of Proi;rcss 
3nd I(iip.aci 




Dissemination 
(expansion) 



Figure 1. The SFi? Design: An Interactive Model for Program Improvement 



for action." Draft a design to apply solutions to needs within ' 
operating constraints, but with flexibility for improve Jnt^f 
necessary. Take care of logistics. ^ tor improvement, if 

2. Initial. Commitment;' Review plan with LEA superintendents Get 
commitment for local team attendance at awareness conSe;ce2 
Distribute advance reading materials -to participants! 

ortr;nst;:;ti:n:?\ l'°"'-"' '^^^^^ information): Have each 
at ^^'T' 
Jn^St^^"- n^r^of ?v\l^1f;y-Lm) 

u^-Jufj^pi-J-f:-: -t^^^^^^^^ to^Uanee 
for implementation as planned. timelines and scope. 

selecteri'HpT ^^^^emental application) : Help LEAs implement ~ ^ 
taii'es orfn'role ' T ^^^^^^^ies but involving represen- 

tatives of £11 role groups. Encourage innovation fidelity but 
allow adjustment of scope. ±f necessary. tide„ity but 

' schoo?s"and- = Encourage use of the models in man. 
schools, and share information about successes between LEAsr"^ . 

• 7. ^^^hnlcal Assistance (coaching): Assign MSDE staff (across divi- 

tion-\o bo'nduc' Ln ^"^P^— ^^^^on. and • diLemiL- 

cion, to conduct follow-ups; and to facilitate networking RnilH 
capacity; do not create dependency. necworKlng. Build 

8. Follow-up Training ; -Conduct an intensive three-day training ■ 
session on eath model. f6r prospective implementers (teacherf 
b -::nua11oUoT;r : ' ^^^"^ • Conduct an^u^i or 

staff) in planning/conducting turnkey training. 

hlSr? ^ J. analyze data systematically and use (feed- 

(Da^a on l^:f :Ld° ^^P-vements and publicLe successes 

'The activities outlined above began in 1980. All 24 LEAs were repre- 
sented at orientation conferences. Nineteen LEAs submitted proposals for 
implementation through June 1983. For the 1982-84 school years, five "new" 
LEAS decided to participate, state department support (funding, provision 



of training and technical assistance to LEAs) will continue through the 



1983-84 school year. At that time it is hoped that LEAs will terminate or 
institutionalize their model programs with each district taking responsibi- 
lity for local needs, decisions, and actions. A chrbhology of key 
activities is presented in Table 1: the cycle of planning, training, 
implementation, and evaluation clearly follows the design. 

The Instructional Models 
Four research-based instructional models (innovations) were selected by 
MSDE as potentially useful to all schools for improving instruction in all 
structured academic curricula. They are: Active Teaching, Mastery Learning, 
Student Team Learning, and Teaching Variables. 

• Active Teaching (AT) is a system' of direct instruction developec/by 
Thomas Good and Douglas Grouws^at the University of Missouri. / 
Originally designed for the teaching of mathematics, AT consists of 
the following components: 1) pre-lesson development — concepts and 
skills from cthe previous night's homework are reviewed, homework is 
checked and collected, and students engage in mental exercises; 2) 
lesson development — prerequisite skills and concepts are briefly 
reviewed, new concepts are introduced via teacher explanation and 
demonstration, and student comprehension is assessed through 
controlled practice; 3) seatwork — uninterrupted, individual, 
successful practice is provided in order to increase proficiency in 
the skills and concepts taught; 4) homework — homework is assigned 
related to the concepts developed that day; and 5) review/ ma in ten- • 
ance — weekly and end^of-un^tt reviews' Tie Ip to maintain skills and 
concepts taught. 

• Mastery Learning (ML), developed by Benjamin Bloom and James Block, 
combines curriculum alignment and diagnostic/prescriptive instruc- 
tion with a philosophy that all students can succeed. Essential 
components are: 1) developing a scope and sequence of objectives, 
broken down into prerequisite and component • skills; 2) providing 
appropriate instruction aligned with the objectives to be mastered; 

3) testing the student's progress in mastering the objectives 
through the use of a formative evaluation measure ("no fault" test); 

4) providing students who have not achieved mastery with additional' 
corrective work in the • deficient areas specified by the formative 
tests, and providing students who have achieved mastery with 
enrichment activities to reinforce and supplement learning; 5) o 
testing final mastery of the objectives with a'summative evaluation 

O .. ■ Q ^ 
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Table 1 

Chronology of Key^SITlP Activities 



1. HSDE preparation begun 

2. Comitoent given by LEA super- 
^ intendents S developers re. 

^awareness conferences 



lLocal]?^osalsluboii£tedto 

5. 1 MSDE/lEA/developer planning 

I sunnier institutes 
(i.;HSDE technical assistance 

; provided 
l\ Four sumnier institutes held 



v.; Inpleaentation (by 19 LEAs) 
I0.| Follov-up training conducted 
U.: Instructional leadership 

, conferences conducted 
12.; Evaluation report distributed 
jimplenientaKon) 



1980 
Jim J Sept Dec 



13;' Planning and orientation for 
j' , nev" lEAs 

1*;. Iropleuentation (by 5 "nev" 
LEAs) 

15. Follow-up training conducted 
ij« Conbined sunmer institute held 
IiJocalilansJi^^ 

(lnpact) 

19. follow-up training conducted 
0. MSDE/LEA planning reviewed 
21. .Locffl Wship" for institu- 
tionallzatlon or terilnatlon 
^'''^"^ion report distributed 
(institutionali2ation) 



1981 

March June Sept Dec^ 



1982 

Harch June 'Sept Dec 



1983 

l'"ch June Sept Dec 



1984 

jrch June Sept Dec 




measure; and 6) recording student progress in terms of individual 
mastery of specific objectives. "Mastery" is usually defined as 80% 
of the students demonstrating success on at least 80% of the 
objectives in a given unit of instruction. 

• Student Team Learninf^ (STL) techniques use peer tutorin.q; and team 
competition to facilitate student learning. Student Team-Achievement 
Divisions (STAD) and Teams-Games-Tournaments (TGT) were developed by 
Robert Slavin and staff at the Johns Hopkins University.' Jigsaw was 
started at the University of California at Santa Cruz. The key 
factors of STL are peer interaction, cooperation, and competition. 
STAD is basically team learning; TGT is team learning plus competi- 
tion by ability level; Jigsaw is team learning of specific elements, 
of a program, with regrouping for peer teaching across elements. x 

• Teaching Variables (TV) was developed by David Helms and staff at 
Research for Better Schools (RBS). Two variables found to be 
strongly related to effectiveness of instruction and student 
achievement were identified: "conterit" and "time." The "content?"' 
variable encompasses two factors: 1) assessment of prior learning, 
and 2) alignment of curriculum objectives and classroom instruction 
to the testing instrument. The "time" variable improvement cycle 
involves: 1) measuring student engaged time (SET) via classroom 
observation, 2) comparing SET and opportunity for improvement, 3) 
reviewing and selecting research-based improvement strategies, 4) 
implementing strategies, and 5) using additional classroom 
observations to evaluate the effectiveness of the strategies in 
improving SET. 

The innovations vary in complexity. Complexity was determined on four 
criteria: 

• knowledge — how much that is new must be learned? 

• materials — how much do classroom materials need to be redesigned 
or developed? 

• meTHods'^^^^nTow^^ are done in 
the classroom and in the school? 

• organization — how much role change and administrative action, are 
required? 

Each innovation was rated on a scale from 1 to 5 (with 5 indicating high 
complexity) on each criterion, and a mean rating was assigned. (See Table 2.) 
As designed, the Innovations in order of complexity are: Active Teaching 
(1.62), Student Team Learning (2.37) , -^ftastery Learning (3.12)', and Teaching - - 
Variables (3.75). 



As implemented. Teaching Variables was less complex than Mastery 
Learning since 60% of TV implementers used only the "time" variable. AT and 
STL. as implemented, were simple and classroom-based, requiring less support 
from school administrators and central office staff than ML or TV. ML and 
TV were both complex and school-based, requiring cross-hierarchical 
coordination. ' 

: Table 2 

Complexity of the SITIP Innovations 



^"^"■"^---...^.^^ Topic 
D imen s ioii ---^.^^^^ 


AT 


ML 


STL 


TV 


knowledge 


2 


3 


3 


5 


'materials 


2 


4 


4 


3 


methods - in class 
- in school 




4^ 3.5 






organization 


1 


2 


1 


4 


total 


6.5 


12.5 


9.5 


15 


mean 

Mean ratlnan va-rv 


1.62 


3.12 


2.37 1 


3.75 



AT = Active Teaching. ML = Mastery Learning. . 

STL - Student Team Learning. TV = Teaching Variables 



Summary of Findings; December 1980 ^n June 1 
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The nature of the innovation is one of many factors influencing imple- 
mentation. Other influential factors, include strategies.* nature and extent 



17 



of training and assistance, local commitment and nature of involvement, etc. 
During the first 18 months of SITIP a study was conducted to examine such 
factors and their relationship to successful implementation of the models. 
Two areas were addressed: / 

• the activities of MSDE, including training events and the delivery 
of technical assistance (TA) 

• the activities of local educators, including participation in and 
reaction to state initiatives, as well as implementation of 
instructional models. 

It was expected that no single, role group (e. g. , teachers) could or 
should accept f^l responsibility for implementing a model. The study 
therefore attempted to identify the tasks needing to be done and how the 
work was shared among the role groups (i.e., teachers, school-based adminis- 
trators, central office staff, and MSDE staff). Findings discussed in that, 
report (Roberts, et al., 1982), distributed to LEAs in October 1982, are 
summarized here. In comparing innovations, the following should be kept in 



mind: 



• Active Teaching; Strategies required active involvement from all 
role groups. The innovation as implementedo,VTas simple and clasg-- 
room-based. Scope was larger than for any other topic (33 schools 
472 teachers). \ . , * 

• Mastery Learning; Strategies were school-based. The innovation as 
implemented was complex and suggested a "need "for cross-hierarchical 
coordination. Scope was moderate (81 teachers in six schools). 

• Student T eam Learning ; Strategies were primarily teacher-oriented 
or classroom-based with initial involvement or light monitoring by 
school administrators and central office staff. The innovation as 
implemented was fairly simple and classroom-based. Scope was 
moderate (100+ teachers in 20+ schools). 

V 

• Teaching Variables ; Strategies were primarily school-based with 
active involvemen.t by central of f ice staff in three of/ the five 
LEAs. The innovation as implemented was moderately complex suggest- 
ing a need for interaction between observers and teachers observed. 

- Scope was low (50+ teachers in six schools). 



Regardless of the model adopted, it was found that certain roles and 
responsibilities were effective in facilitating instructional improvement: 

• ^ft^r?" initiate, encourage voluntary participation, build and 
rt^lTrll connnitment. and provide (research-baseS) assistance as 
resource coordinators. o 

. Central office staff engage in cross-hierarchical communication, 
linking schools and LEA to SEA. and act aa resource coordinator^ by 
th'an 1"' support services. If implementation is in ^ore 

than one school. CO staff function as "project directors." 

• School-based administrators ensure that teachers' concerns are 
ftuTtlJ ^^'-''^^ ^""^ affective), and function as supportive 
f^a nLhthonL"^T'^"^ sometimes with "project director" status 
ir a ilghthouse school" strategy is used. 

• Jeachers carry out classroom implementation tasks. Also, teacher 

representatives support others by "turnkey traininR." especially for 
capacity building sites, and, vhen implementation ?; single-scJooJ 
focused, teachers c..n function as "project directors" if administra- 
tors (school or central office) do not take on that responsibility! 

Other findings of this study, relevant to role group responsibilities 
suggest the following conclusions: 

• Initial staff interest or commitment to implement a new program or 
practice can be built if: (1) the superintendent pemlts staS to 
tHe-in'nrM "7"' '° implement if app^;p^i: (2) 
mity Ind ?3)"taff\'^r'"'\'^'^"^'°P^^ have val'iSity and, credl. 
inf iSAcrdecisi^ns ' '^''^"^ ^'^^ ^'^^ '° 

/ - . . 

• /Staff interest is the most important factor in selection of the 

^/ jnnoyation and in determination of elements of the LpJementaUon 

Cross-hierarchical planning facilitates mutual understanding which 

Morb^LJJ"'"' implementation (such as coLunica- 

tion breakdowns, resentment, feelings of isolation). ■ 

Representation of the various role lyrounn in t,1o„„-. j u 

de=isio„-^Mns. build, „„d««indL^"z%oi;r:^„"„^:"i^rir' 

slon of role group per=pect:lves. „d strengthens or^^J^a^lona? 
ana new staff will not be given a one-sided briefing. / 
Z^rS^T^^^^^-' '-e amount oj .orW to be 

The implementation strategy determines how the work is shared ^mnr^a 
role groups and how the burdens shift among roirgloups Sver tSe?' 
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The implementation strategy plus the scope (number of schools, 
teachers, currlcular^ subjects, grade levels, .amount of time for the 
innovation to be used for each class or subject) determine how much 
work is to be done within a given LEA. * 

The nature and extent of communication and decision-making determine 
productivity and affect. 

The organizational norms of the LEA determine communication and 
decision-making procedures. / 

Changes in organizational norms are influenced by two forces acting 
almost simultaneously, hut not necessarily collaboratively: 
external ''pressures," (e.g. , TA recommendations); and internal 
"pressures," (e.g., topic advocate recommendations or teachers' 
concerns) . o 

Regardless of the nature of the innovation, all role groups must 
carry out the following tasks, in order of investment: (1) inter- 
active support (acknowledgement, shared knowledge, problem-solving, 
resource allocation); (2) learning/training (before and during 
implementation),; (3) record-keeping; (4) materials identification or 
dv^.velopment ; (5) evaluation; and (6). administration. 

Perceptions of interactive support reflect participants* assessment 
of each others' commitment. Judgements are based not only on how 
much useful help was provided, but also on the visibility of the 
support (with lower ratings for low visibility). 

It is preferable for each role group to perceive high support from 
close role groups rather than distant ones. ' Therefore, visibility 
should be reduced with distance. [For instance, teachers should 
perceive principals as supportive. If there is a problem a state 
technical assistant may help central oif.fice staff (who turnkey ideas 
CO the principal) or the TA (with central office permission) may 
help the principal. But the state TA does not. provide support to 
the teachers when it should more appropriately come from the 
principal.] 

Representatives of all role groups need a thorough understanding of 
innovations to be adopted so tfiat: (1) plans are realistic, (2) 
reassignments do not result in the organization's loss- of knowledge, 
(3) interactive support can occur, (4) no one group is overburdened, 
and (5) there is a reasonable chance for institutionalization and 
dissemination beyond initial pilot sites. 

Impact in terms of student achievement was evident to some extent, 
although not formally expected for the first year of implementation. 
Results sjLiggest (tentatively) that greatest impact was made by 
Mastery Learning, followed by Active Teaching. Student Team Learning 
appeared to influence student affect more than achievement. 
Teaching Variables data are inconclusive. 
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technical "assistance (TA) are most effective when 
ot^^ responsive to the needs of the group (of implementers) 

K-^} task oriented and knowledgeable about local norms 1 the innnva^■Inn 
and processes of planned change, and (3) skillful in facilitat?ng 
shared decision-making and in coordinating communication. 

Designs or plans for instructional improvement are most likely to be 
r.Zrl'''\^'\ Participation (of organizations) is voluntary. (2) 

tr^nW m ' (3) planning is interactivrwith^ 

^' . """^^^^J)^ ^""^ technical assistance are provided during 
meniatlo Jm' ^.V compliance" is not accepted as i^le- 

re^ate to' adjustments of scope are considered legitimate and ' 
mill ? resources available, dnd (7) each participant has some 

the ef forr T °^ involvement (nature or extent) in 

ttie effort. These elements were present in SITIP. 
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III. EVALUATION OVERVIEW 

Durlnr the 1980-1981 and 1981-1982 school years, overall evaluation of 
SITIP was conducted for MSDE by Research for Better Schools (RBS) . The 
evaluation was designed to address" two "levels:" (1) specific events or 
stages of activity, and (2) the overall SITIP program as a viable strategy 
for statewide school improvement. Also. MSDE required the findings to be ^ 
reported on an on-going basis so that data-based decisions could be made to 
bring about program improvements.* During the 1982-1983 school year. RBS 
continued to take primary responsibility for evaluation, but LEAs assu„,ed 
additional responsibilities, and "impact" data received greater attention. 

This chapter summarizes the questions addressed by the study for the 
1982-83 school year, responsibilities and data sources, measures and 
methods, and data analysis and reporting procedures. 

Questions Addressed 
•The study addressed four areas: impact, implementation, dissemina- 
tion, and technical assistance. 

What is the nat.ure and extent of impact : 

1.1 On educators, in terms of: 
1.1.1 increased knowledge 
l.*1.2 change in practice or policy 

^"^"^ ^Pnp^^f^ '° specific topics and to teaching/learning in 
^enerax 

1.2 On students, in terms of: 
1.2.1 change in achievement levels 

cS^^Cti'onr"'" ^"'-* disruption, homework 

1.2.3 change in attitude (e.g.; locus of control, self-conc.-pt 
group participation, willingness to work) '^o^c.-pt. 



1 



_ 0 

In addition to short interim rpnn-r/a i 

staff, and topic r.ports ^evlS^d wltS LeIs a°«.r"" ^"'"'""^ " «SDE 
covering the p„l„d December mo tolu'el^sL^I LrtrV:' 

ln»ruc on. improvement Maryland- . n tudv ^l^.t"- 

run report, ED222486;, executive summary. ED223553. 



2. What is the nature and extent of Implementation ; 

2.1 Within a local system 

2.2 Across LEAs Implementing a given model 

3. What Is the nature and extent of dissemination : 

3.1 Within a local system 

3.2 Between LEAs 

3.3 Outside Maryland 

4. What is the nature and extent of technical assj.stance provided by MSDE 
in terms of: ~ 

4.1 Implementation — planning, training, support 

4. I Dissemination — planning, training, knowledge base/information 
4.3 Evaluation — planning/design, . techniques , measures, data analysis 
and reporting 

Re sponsibilities and Data Sources 
While RBS had primary responsibility for the SITIP evaluation, three 
factors influenced the decision to involve MSDE TAs and LEA coordinators more 
directly in evaluation activities: (1) student achievement data relating to 
impact questions could best be collected and summarized by LEAs, (2) if 
similar measures and methods were used by all LEAs, results could more easily 
be compared across the state, and (3) some LEA and MSDE staff wanted to 
■.improve their expertise in evaluation by becoming more involved: 

~ For these reasons, RBS worked with MSDE TAs to develop an overall 
design and written guidelines for LEA involvement. The guidelines 
summariz'ed the design (see Table 3) , listed role group and individual 
responsibilities, included a 'checklist planning sheet indicating mandates 
^e.g., choice of various given ways to measure student achievement), and 
described measures and methdds. RBS and MSDE staff reviewed the guidelines 
with LEA teams and each LEA completed a planning sheet agreeing to a coor-' . 
dlnated evaluation effort,/ 

1 
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Table 3 

Summary of SITIP Evaluation Desifin (1982-83) 



Impac C On : 
r.duCACors 



Methods jnd Mc*surc« 



• Process observjic Ions 



• Interviews (on-slcc 
or phone) 



Sou rce 



• a CrltlcJl events 
(c- g* , to 1 low-up 
ocednf^ or pilot " 
site events) 



Survey 



S<:udcnts ] • CAT In Hjth and 
j Readl,ng/L.inf;uage 
Arcs 



• Ocher national 
nono-rcferenced 
tests 



Key contact "irson/ 
LLA (24) 

( CO 

LLAs xSA Up to 25/ 
VT LEA (600) 



t>Jit« Colltcclort 
Schcdu I c 



AdtBlnUtered Analytcd 

Ey 



• Selected by 
TAs, 2 per 

topic 



• April '83 



SITIP & Control 
Ss grades 3 , 5, 



SITIP & Control 
Ss 



• Hay '83 



RflS observer 



RflS Inter- 
viewer 



• Oct. 'B2 
Oct. '83 



• Locally developed 
criterion refer- 
enced cesc 



• SITIP 
. Ss 



• Locally developed 
teacher ni*de cri- 
terion referenced 
tests by unit 



• "My Class Inven- 
tory" - student 
attitude -Survey ' 



• SITIP 
Ss 



SITIP 
Ss 



• Pretest - 
Sept. '82 

• Posctist - 
Hay '83 ' 



• Pretest - 
Sept. 'B2 

• Postest - 
May '83 



Ongoing 



• ? qucsclcmnal re 



• SITIP Ss (?;mple) 



Su rve y 



{ Ir:ple- 
j ci»*nt .ic ion 



« Survey 



• Questionnaire 



Process observations 



—(To ■ 

• LEAS ' Sa Up to 25/ 
LT LEA (600) 



• Pretest - 
Sept. *82 

• Postt'st - 
May '83 



• Kctv. '82 
May '83 



• May '63 



. (co 

• LEAs J Sa Up to 25/ 
(j LEA (600) 



• LEA key contact 



• TA oectlngs 



D I s s f 
tn.u. Ion 



• TA log^ 



• Survey 



• Critical events 



• May '83 



' Pre-Sept. '82 
Post-K-iy '83 



I Monthly 



• Selccteri by 
TAji . 2 per • 
topic 



• MSDE TAs 



Tecnn lea 1 
1st ance 



('co 

I • LEAS ' SA Up to 25/ 
{t lea (600) 



• Ta logs 



• Process observjic Ions 



• HSOE TA3 



' Monthly 



• M.iy -83 



• TX racct lng» 



• Mont hly : 
AiJg, .'82 
*Aug. *83 



• Interviews 



• . fcedb.cV f oras 



• MSIJE Tas 

• l.EA Vcy contacts 



• Monthly; 
A^R. '82 
^R. '83 



' March-April 
•83 



• L£A follow-up 
p«rtlclpAnt« 



' Selected by 
Ta, 



LEA 



RflS 



SEA 



LEA 



LEA 



T* 



^^A 



LEA 



LEA 



LEA 



LEA 



Ras 



RBS 



TAs 



LEA 



TAs 



RBS 



RBS 



TA. 



LEA 



LEA 



LEA 



Ts/LEA 



RflS 



RBS 



RBS 



pas 



RBS 



RBS 



RBS 



, In general. RBS was responsible for design, development, analysis, and 
reporting. MSDE TAs were responsible for coordination, distribution 'and 
collection of materials (e.g:. questionnaires), and ^assistance to LEAs in 
following the guidelines (e.g.. how to score and summarize student attitude 
surveys). LEA coordinators (key contacts) carried out tasks similar to 
those of TAS. but each in his/her own district. LEA evaluators worked with 
coordinators to collect, score, and sunnnari.e data, particularly that 
collected from students. (Local responsibility for these tasks not only . 
increased local involvement and awareness of ; program impact, but also 
ensured that concerns relating to "protection of human subjects" were dealt ' 
with appropriately.) 

Information-materials, interviews, survey responses-was provided by: 
(1) the seven MSDE TAs and the SEA assistant deputy superintendent; (2) LEA 
central office staff directly involved in SITIP (usually between one and three 
people for each of 24 LEAs); (3) school-based administrators (up to 10 per 
LEA); and (4) teachers (up to 20 per LEA). Also large numbers of participants 
of state-sponsored traininr events provided information either directly 
(responding to questionnaires) or indirectly (observed by RBS). 
- Students also completed cognitive and affective measures.* Usable data 
from cognitive measures (e.g.. California Achievement Test) were suimnarieed by 
9 LEAS and -submitted to RBS. Usable data from affective measures (e.g.. 
Learning Environment Inventory) were sununari.ed by 14 LEAs and submitted to 
RBS. Two of the 14 LEAs used their own questionnaires to measure student 



attitudes. 



* While MSDE expected all "veteran" LEAs MqW^ o u • ^ 

several did not do so. for ^variety of^JloL! — aries. 
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Measures and Methods of Data Collection 
Six general methods of data collection were used: observations. Inter 
views, questionnaires, document analyses, and measures of student attitudes 
and achievement. 
Observations 

The evaluation design Included observations by RBS staff of eight 
critical events (two per topic) selected by the MSDE TAs. These critical 
events could consist of training activities conducted by the TAs or site 
visits to participating school districts. 

Four MSDE training events were observed by RBS staff. These events 
consisted of one follow-up each for AT, ML, and STL, and one combined 
follow-up for AT, STL, and TV. In addition, RBS staff . conducted process 
observations in four LEAs, and at two state-wide conferences — one in May 
1983 at which all 24 LEAs made presentations, and one in July 1983 at which 
new LEA staff were trained, and all LEAs updated their plans. (RBS staff 
were assisted in observing the May conference by MSDE-supported st^f^f 
involved in another project.) 

Monthly technical assistance meetings were observed to determine the 
nature and extent of assistance and the operating opportunities and con- 
stralnts.. 

In all cases comprehensive notes were taken, objectively describing 
what occurred and indicating time elapsed (about 400 pages of field notes). 
Reports on the training events were submitted to the TAs as soon as 
possible <ln most cases within ten days) alter the event. Notes of the 
training events and TA meetings served as data bases for the annual 
evaluation report. 

2b 
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— ^Interviews— - ~ 

Telephone interviews were conducted by RBS with LEA key contacts during 
the suimner of 1983 in order to verify and clarify, if necessary, information 
provided by the LEA. 

The MSDE TAs were interviewed individually on questions relating to 

their role in SITIP, perceived successes, and recommended improvements. 

; ' Informal interviews with local impleraenters were conducted during site 

visits and at training events. 

Ques t ionna ires 
~ — 

Three questionnaires were used: (1) Key Contact Questionnaire, (2) 
Follow-Up Feedback Form, and (3) General Survey. Each one is described 
below. . 

Key Contact Questionnaire. In each LEA, for each topic implemented, 
the project's key contact person was required to complete two versions of 
the questionnaire: a "pre" version in September 1982 and a "post" version 
the following May. Items on the questionnaire related to level of implemen- 
tation (e.g., numbers of schools, grades, teachers, classes, aftd students 
involved), LEA objectives for the SITIP project, and extent of dissemina- 
tion of the topic within the LEA. 

Follow-up Feedback Form. LEA participants of MSDE training or follow- 
up events were required to complete feedback forms, items on the forms 
related to such features as clarity of objectives, utility of the activi- 
ties, quality of support and assistance from MSDE staff, and future needs. 

General Survey . A general -vey was developed by RBS and completed, 
by up to 25 respondents in each LEa chree role groups (e.g., central 

office, school administrators, teacherr.) . Survey items related to imple- 
mentation, perceived impact, dissemination, and technical assistance. 
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Document Analyses 7" ' ' 

All materials developed by MSDE for planning, training, and communica- 
tion about SITIP were reviewed by RBS. Materials (including video tapes) 
developed by all LEAs used at follow-up meetings and state conferences were 
also reviewed. Some LEAs also provided copies of classroom materials, 
training packages, and evaluation reports. 
Student Assessment 

While the General Survey, completed by local educators, included 
questions relating to perceived program impact on students in terms of 
attitude, behavior, and achievement, data were also collected directly from 
students to determine their attitudes and to assess achievement. MSDE 
expected all 19 "veteran" LEAs (24 project sites) to assess program impact 
on students, and to report the results to RBS. "New" sites (5) could submit 
data if they wished. In fact, usable affective data were received from 14 
LEAs, etnd usable cognitive data were received from 9 LEAs. Eleven LEAs 
submitted no usable student data of any kind. Of those eleven LEAs, one was 



a "new" site. 



Student Attitude Measures . LEAs could elect to use a given question- 
naire or one of two surveys to assess attitudes. ] 

The questionnaire (elementary and secondary versions) measures 
students' enjoyment, interest, and perceived learning. LEAs using this 
questionnaire were told X<f: 

I 

1. -Administer the appropriate (elementary or secondary) questionnaire 
to SITIP students twice ~ once half-way through the year (oir 
course) and once at the end, asking students to respond for the 
SITIP class in comparison with others for the same subject. | 

i 
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2-i Score-and-ana-lyzejre8ponse8-by-cia88i;-a8Bign-lng^-ea-ch--veTb^-l 

response. a numerical score: a lot - 5, a little - 4, don't 

-jcnow = 3, not much « 2, not at all = 1. 

^' /t^c"^^*"^ responses by class, by time, by item, and send them to 
/ RdS • 

Thj surveys are more complex than the questionnaire. The Learning 
Env'Xronment Inventory (secondary level) has eight scales measuring the 
foliowijiig areas: competitiveness, satisfaction, difficulty, friction, 
disorganization, apathy ., favoritism, and environment. The My Clais • 
Inventory (elementary level) measures the first four areas mentioned above 
LEAs interested in using these surveys to measure student attitudes were 
told to: 

1. Obtain copies of the survey manual from MSDE staff, determine 
appropriate scales, identify relevant items, and produce copies o 
the resulting measure to be used with students. 

2. Use the measure as a pretest/posttest with SITIP students 
(Control students — matching classes taught by the same teacher 
when possible — may also be involved.) 

3. Alternatively, use the measure as a posttest only, either: (1) 
asking SITIP students to complete it twice, once for the SITIP 
class/subject and once for a similar class/subject, possibly 
taught by the same teacher; or (2). having SITIP students complete 
it once, and attaching to the results a note from the teacher as 
to hoped-for responses. 

4. Score and analyze results, and send summaries to RBS. 
Achievement Measures. LEAs were required by MSDE to assess student 

achievement. Guidelines stated: ' < 

Achievement may be measured by the CAT -or other norm-referenced 
tests, or by criterion-referenced measures. While it is theoret- 
ically desirable to pretest and posttest students comparing 
results of. SITIP students with similar populations in "regular" 
classes, this traditional design is not always possible. Alterna- 
tiyes include: (l) long term trend analysis comparing "posttest 
on^y results j^ith those th§t might be commonly expected, or (2) 
pretesting and posttesting SITIP students using criterion 
referenced tests. Whichever method is used, it should be undev^ 

°^ program success" or "objective value" of 
bLLLF Should be made with caution. 



Specific procedures were described referring to use of various kinds of 
measures: California Achievement. Test , other norm-referenced tests, or 
criterion referenced tests developed by the LEA or classroom teachers/ 

Analysis and Reporting 

Data were analyzed for each question by model, by LEA, and by role group. 
Also, data were analyzed to determine correlations among activities, role 
group Involvement /investment, and outcomes. 

Data were analyzed as soon as possible after collection. Summaries were 
prepared and reports made to the MSDE team, orally about once a month and In 
writing for formal events. Turn around time for those written reports was 
usually seven to ten days.* 

This system of on-going analysis and reporting assisted^ the MSDE team In 
making data-based decisions to plan Interventions and make program 
Improvements. , 



* Several reports were developed about SITIP activities for the period 
December 1980 to June 1982. During the 1982-83 school year, copies of 

^ some of those documents were reviewed with LEA teams, LEA superinten- 
dents, and MSDE assistant superintendents. 



IV. STATE INITIATIVES AND ASSISTANCE 



In support of local implementation of four models of instructional 
improvement, the Maryland State Department of Education (MSDE) initiated - 
activities relating to three areas: planning, training, and technical 
assistance. ^In order to. carry out those activities effectively, organiza- 
tional structures and mechanisms were established which built upon previous 
effortfu This chapter presents general background information, describes 
organizational structures, reviews events for the three areas of activity, and 
presents related conclusions. 

General Background 
In the fall of 1980, MSDE initiated the School Improvement Through 
Instructional Process (SITIP) program,, which involves local education 
agencies (LEAs) in implementing instructional models proven to be effective 
in increasing student achievement. The models are: Active Teaching, 
Mastery Learning, Student Team Learning, and Teaching Variables. All four 
models are research-based and were selected by MSDE as potentially useful to 
all schools for improving instruction in structured academic .curricula. 
Year 1; 1980-8 1 . 

During the 1980-81 school year, teams of educators attended orientation 
conferences conducted by ^the rese^archers/developers of the models. Then 19 
LEAs submitted plans to implement one or more of those models, received 
grants (up to $5000 per LEA per year) , and participated in further training 
and planning activities sponsored by MSDE. 
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Year 2: 1981-82 



During the 1981-82 school year, nearly 700 teachers in grades K-12 used 
one or more of the models in mathematics, reading/language arts, science, 
social studies, ^ or other academic areas. In each of the 19 LEAs, SITIF 
teams were formed, including teachers, .school-based administrators, and 
central office staff. These teams were assisted by MSDE technical 
assistants (TAs)— two people per model— who visited local sites, facilitated 
problem-solving and networking, and conducted one or two "follow-up" 
training events attended by all teams implementing a given model. 

In addition to conducting activities relating to a specific model, MSDE 
also sponsored an Instructional Leadership Conference in May 1982 focusing / 
on quality instruction (addressed by Barak Rosenshine) and staff developme4 
(addressed by Bob Bush and Bruce Joyce). The conference was attended by/ 
about 500 local educators, including SITIP team representatives. (KSm 
staff also attended a conference conducted by the samq presenters.) 

To further reinforce the instructional improvement theme, MSDE 
commissioned Research for Better Schools (RBS) to write a paper syZhesizin'g 
research on instructional improvement and planned change.* That paper was 
subsequently used as a knowledge base for several MSDE-sponsored training 
events in the 1982-83 school year. 
Year 3: 1982-83 

During the summer of 1982, the five LEAs that initially had not 
participated in SITIP became part of the program and received appropriate 
assistance and funds from MSDE. Funding, assistance, and model-specific 
follow-up training events continued for all LEAs throughout the year. 

.*. Roberts, J.r.E., & Smith, S. Instructional improvement; A system-wide 
approach . - " ■ 
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In early fall 1982, an RBS evaluation report covering the 18 months 



beginning December 1980 was released'; Ind ■the ■ executive' su^^^^^^ and " section s""^ 
relating to local implementation of specific models were distributed and 
discussed by key interest groups. Some findings influenced subsequent 
activities. 

The spring 1983 Instructional Leadership Conference included presenta- 
tions made by each of the 19 LEAs first involved in SITIP, and focused on 
teacher effectiveness (Madeline Hunter) and planned change' (Karen Louis). 
■Those two presenters also addressed MSDE staff and college faculty at separate 
conferences. The RBS synthesis paper was used as advance reading for the LEA 
conference, and was the basis of several other presentations and training 
events to state and local administrative and supervisory staff. 

By June 1983, 23 LEAs were committed to a third year of SITIP implemen- 
tation, all with matching state funds,, and all planning expansion.* In July, 
MSDE sponsored a Summer Institute to train new implementers and assist lopal 
team planning. 

The SITIP design caUs for flexible state leadership, and involvement of 
all role groups in planning, training, and implementation. MSDE sponsors 
planning and training events, carries out technical assistance and evaluation, 
and facilitates local implementation and dissemination. Local involvement is 
voluntary, but lip service compliance is not accepted as implementation. 
Local investment (time, money, and commitment) is high and is influenced by 
the nature of the design, the quality of technical assistance and training. 



* ?Q«-.^«? expansion and did not request MSDE funds for the 

m!nt"fh.'S??i ; ^"'^^^^"^'l teachers/schools may continue to imple- 
ment the SITIP model on their own. 
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and the perceived value of the models Implemented. In general, as SITIP 



gained visibility within the state, central office staff (especially superin- 
tendents and assistant superintendents) gave more attention to the program and 
to the relevant research bases. - 

Organizational Structures 
The organizational structures used for SITIP evolved over time to ensure 
appropriate participation of role groups and hierarchical levels. Multiple 
channels of cuimnunication were used, with careful attention to sending 
consistent, clear, timely messages, and to maintaining personal contacts so 
that local educators could readily exchange information with MSDE. While 
appropriate attention was paid'^to lines of authority, cross-level or cross- 
division mechanisms were also used or developed to facilitate coordination. 
This section outlines the structures and mechanisms which did evolve. It 
refers to MSDE decision-making, the placement and responsibilities of MSDE 
staff assigned as technical assistants, and MSDE/LEA communication. 

SITIP was initially designed by staff of two departmental units of MSDE, 
building on needs and successes of existing programs relating to professional 
development academies, technical assistance. Project Basic (the state 
competency-based education program), and the implementation of research-based 
processes and models. Once approved by the state superintendent, SITIP was 
reviewed by the Instructional Coordinating Council .(ICC) ~ the state superin- 
tendent, assistant deputy superintendent, and MSDE assistant superintendents 
each responsible for a particular division/department. ICC members agreed 
that SITIP would become a jointly-sponsored program, coordinated by the 
assistant deputy superintendent (ADS), and supported by the person time of 
selected division staff with field responsibilities. These staff became the 
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SITIP technical assistants (TAs) , each "expected" to spend about two days a " 
month on the program. They continued their usual tasks, and. for SITIP. 
reported to the ADS. 

^^^^^ TA team was chaired by the ADS and included eight TAs (two per 
model) drawn from the Divisions of Instruction; Certification and. Accredita- 
tion; Instructional Television; Library Services; Compensatory, Urban and 
Supplementary Programs; and the Office of Project Basic. The team met monthly 
to review progress, assist each other or share materials, and to plan forth- 
coming activities, individual members took on specific tasks most closely 
relating to their "regular" work. Most general administrative work (e.g., 
coordinating local plans and allocating funds) was undertaken by the two TAs 
who routinely reported to the ADS. Each partnership was free to determine 
what technical assistance should be offered and how work should ^be shared. 
Members were expected to network about SITIP within their own divisions, 
spreading successful concepts and building a general knowledge base among MSDE 
staff. This communicatlcu was not as strong as was initially planned. 

Communication between MSDE and t:he 24 LEAs initially involved the ADS and 
LEA superintendents, and that channel continued to be used for formal informa- 
tion exchftuge. Subsequently, the local council of assistant superintendents 
(that resets monthly, chaired by the ADS) became a communication channel. The 
SITIP model required involvement of cross-hierarchical local teams,, and once 
they were established MSd'e TAs Could contact specific teachers'; school-based 
administrators, and central office staff. Usually one of the latter group 
(or, more rarely, a school administrator) was designated as the local project 
coordinator and became the key contact for LEA MSDE SITIP communication. In a 
few cases a project coordinator was so little involved in SITIP that someone 



else (usually school-based) became the key contact, especially to review 
Implementation progress or needs. Important' Information (e.g., about the 
annual Instructional Leadership Conferences) or materials (e.g., evaluation 
summaries) were shared In several ways through several channels (e.g., 
councils of superintendents and assistant superintendents, mailing, TA local 

on-site visits, follow-up i training events), with senior administrators 

i • ^ ■ 

I 

receiving information first, but other channels used to ensure that "desk-work, 
blocks" did not delay or^prevent communication. (Even so, such blocks did 
occur at times, indlGating a need for TAs to encourage better communication 
within some LEAS.)' 

SITIP policies and activities were planned by the TA team, with members 
taking into account local needs arid interests. Plans were reviewed, revised 

if necessary, and approved by the ICC. Operational specifics were negotiated 

\ 

with LEA superintendents and SITIP teams. In general, the SITIP TA team took 
primary responsibiiity for leadership and administration of the program, with 
the ADS responsible\^o the ICC for maintaining quality and cost-effectiveness. 

Planning 

This section reviews planning processes and activities initiated by MSDE. 
Following a brief review\of efforts up to June 1982, two areas are addressed: 
planning within MSDE, and^planning with LEAs. 

■ \ ■ • ' ■ • ■ 

Planning 1980-June 1982 \ 

The preliminary design of SITIP was developed in 1980 by MSDE staff, 
reviewed and approved by the ICC and the LEA superintendents' council, and out 
into action by staff responsible for staff development and Project Basic. By 
July 1981, the SITIP TA team had been formed, and planning responsibilities 
were assumed by that group (withlreview and approval by the ICC). Planning 
for the firs^t 18 months focused ol[i: 
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• Overall design ; program purpose; leadership; funding and other means 

or--suppo-rti~substan«T-proee9s-,-and-procediir«a;--t-ra-iijing-i--l 

participatioh requirements; and evaluation 



• Modification of the design; consideration and init;iation of changes 
indicated by the relative success of early activities (e.g., inclusion 
of technical assistance, flexibility in local Involvement issues) 

• Specific t/raining events; the orientation conferences for the four 
models matching summer institutes, follow-up activities conducted by 
TAs, and /the 1982 Instructional Leadership Conference 



rcT.^?wT guidelines; procedures; clarification of the reality 

ot SITI^ intentions (e.g., requirement for cross-hierarchical team 
involvement, and real—not lip service— Implementation) 



• -Lo^al pllanning modification; reformatting of guidelines; negotiation 
of changes or reductioils- in LEA intentions based on clearer under- 
standiiig of the demands of SITIP models 

• |Xaluation:' initial design, and subsequent modification to use fast 
feedback on critical events to inform decisions. 



Planning .Within MSDE (June 1982-June 198.3} 

Within/MSDE three types of planning activities occurred: (1) resource 
allocation /and policy making by the ICC. (2) program modification by MSDE 
divisions/ and (3) program development and modification by the TA team. 

ICC /planning related to SITIP occurred during their regular monthly 
meetings/. The ICC reviewed progress reports and TA team recommendations, Ld 
subsequently determined resource allocations. For instance, continuation of 
TA support was approved for the 1982-83 year (at 10% time for each TA) and for 
the W83-84 year (at 15% time for each TA) . Local grants were approved, with 
from/$300g to $5000 available for each LEA., but, for 1983-84, participating 
LEAj'had to provide matching funds. Funding for Instructional Leadership. 
Conferences, follow-up training, and evaluation was also approved, with 
amounts for the 1983-84 year cut by about 40% (reflecting overall budget 
cuts) . 
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MSDE division planning was independent and case-specif ic, involving 
modification of existing programs to 'incorporat^^ 

content of SITIP perceived as valuable and relevant to particular programs. 
Influence or initiative originated from ICC members (division directors), TAs, 
or branch chiefs who rea'd SITIP materials or participated in SITIP-related . 
activities. For instance, an ICC member (director of the Division for 
Compensatory, Urban and Supplementary Programs) gave a research synthesis to a 
.branch chief. Impressed by the synthesis, the chief discussed implications 
with the TA in his branch. Together, they drafted tentative plans, expanded * 
ideas with other branch staff /and RBS) , then used SITIP-related knowledge and 
processes for their annual state conference (attended by Chapter I coordina- 
tors and LEA assistant superintendents). In another division, a major program 
vas launched (Utilizing Research to Affirm Teacher Education—URATE) , in which 
researchers (e.g., Berliner, Cohen, Hunter) addressed representatives of 
institutes, of higher education. Planning for URATE, and for ways to link 
URATE and SITIP participants, involved SITIP TAs and MSDE staff of the 
Division of Certification and Accreditation. Individual TAs were influenced 
by the SITIP knowledge hAse (on instructional improvement and planned change) 
and incorporated it in their "regular" work in various ways. Also, the 1982 
Instructional Leadership Conferences (focusing on staff development) 
stimulated review of practices in several divisions, with some modifications 
to increase impact. 

TA team planning occurred during regular monthly TA meetings and sub- 
sequently by sub-groups or individuals accepting specific tasks. Planning' 
related to all areas- of the program, with most attention to trainin^^! 
Instructional Leadership Conferences, Follow-up, sessions and the 1983 Summer 
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Institute); the improvement of assistance to LEAs; and to evaluation. The 



more-<romplex-aiv-^Ma-of-~a<s^t4vlty.r.t he-earl^ began.* In 

general, an open systems planning approach was used: objectives and target 
audiences were specified; substance and process were developed together; 
..material and political support* were taken Into account. 

• Training ; General level planning for the '83 Conference and Institute 
began In May 1982, with main objectives, target audiences, presenters, 
and: resources determined by June. Specifics were__determlned subse- 
quently, with all LEA superintendent approvals in hand by December 
'82. Follow-up planning was initiated three to six months before a 
given event. 

i' 

Assistance : Planning was on-going, flexible, context-specific, 
anticipatory, and proactive as much as possible. SITIP administrative 
efforts (e.g., collection of LEA PEPPs forms, identification of LEA 
key contacts) to facilitate formal documentation or funding require- 
ments were coordinated by one TA: energy and enthusiasm were 
relatively low for these routine activities. . SITIP program efforts 
(especially, strategies to overcome' specific barriers to local imple- 
mentation) received much greater attention, with full days spent in 
July 1982 and May 1983 reviewing and planning, technical assistance 
strategies and activities (in light of relevant research). 

• Evaluation : Planning was interactive, with RBS staff and TAs 
reviewing and modifying annual designs each June, then TAs reviewing 
designs with LEAs at the beginning of the school year. Evaluation of 
training was planned .as events were planned. Primary planning/design 
responsibility was assumed by RBS. Planning for review of evaluation 
results, or consideration of findings in program improvement was the 
responsibility of the TA team. ' 

Major outcomes of these planning activities (other than the implementa- 
tlon-of the plans) included: (1) a general knowledge of SITIP by most MSDE 
staff, (2) sufficient commitment or Interest by senior and middle management 
to be willing toexplore elements or knowledge bases of SITIP, and to continue 
(and, expand) cooperative support for technical assistance,^ (3) increased know- 
ledge and skills in instructional improvement and planned change by members of 



* Complexity related to: extent of participant input in planning; proces 
for approval and/or funding; number and variety of role groups involved 
participants and/or presenters; number and variety of content areas or 
models addressed. ' 
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the TA team (which Informally filtered back into other program areas), and (A) 
application of SITlP-related information, strategies, or processes in various 
existing programs. While some 'programs were influenced by SITIP, there was * 
little impact on policy or practice of other instructional programs. This 
reflects less on the SITIP design than on organizational norms: established 
philosophies and priorities of individual divisions outweighed the possible 
value of the SITIP knowledge base, and the pressures of everyday tasks out- 
weighed the appeal of information offered informally by TAs.^ 
Planning With LEAs (June 1982-June 1983)* 

Planning related to SITIP betweeji, MSDE and LEAs used several channels, 
involved various state and local groups, and related to: planning and project 
administ ration , implementation , evaluation, and training . For each 
topic, a given channel (role group) might carry out any of three responsibi- 
lities': re^-tew, commitment, or involvement. Table 4 presents topics and 
channels, and the following discussion reviews each topic and then each kind 
of„ responsibility . 

Usually, the Assistant Deputy Superintendent (ADS) represented MSDE for 
planning activities with LEA superintendents and assistant superintendents. 
Sometimes the State Superintendent; was involved, especially for formal 
communication of new efforts. Occasionally TAs were involved, especially 
for specific on-site review or problem-solving. SITIP TAs were primarily 
responsible for planning with local project directors, evaluation coorJlna- 
tors, and SITIP teams. While almost all communication or activities related 
to planning were initiated by JdSDE for general. SITIP activities, LEA groups 

* Planning within LEAs {e.g., implementation design or the specifics of 
evaluation), is not discussed here; the focus is on MSDE initiatives. 
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Table 4 



MSDE/LEA Planning Topics and Channels 



Channels ^^^--^^.^^ 


Project 

Administration 


Implementation 


Evaluation 


Training 


LEA Superintendents 


review 

commitment 

Involvement 






review 
commitment 


LEA Assistant 
Superintendents 


review 


review 


review 
commitment 


review 
Involvement 


LEA Evaluation 
coordinators 






review 
commitment 




SITIP Project 
Directors 


review 

Involvement 

commitment 


i:evlew 

Involvement 

commitment 


, review 
commitment 


review 

Involvement 

commitment 


SJTIP Teams 


"review 
commitment 


Involvement 
commitment 


review 
commitment 


review 

Involvement 

commitment 
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also initiated some planning (e.g., topic selection for the assistant super- 
intendents' conference, October 1982), and individual LEAs also invited TAs 
to participate in local planning. 

General SITIP planning and project administration included a require- 
ment by MSDE that each LEA complete a PEPP (Promising Educational Program or 
Practices) form. These single-page- forms addressed objectives, target 
audience, staff development, etc., and so served as summaries of local 
intentions. PEPPs were compiled and distributed to all LEAs, at the request 
of local superintendents, to facilitate local networking. In 1981, 19 LEAs 
completed PEPPs which covered activities through June 1983. However.' the five 
LEAs that were not involved at first, decided to participate in 1982. Those 
five local superintendents initiated the request /they were influenced by 
colleagues from other LEAs who were impressed with SITIP. The "new" LEAs 
needed to complete PEPPs and apply for MSDE ilnds (approximately $3000 per LEA 
for one school year). Preliminary negotiation involved the ADS and the five 
LEA superintendents. Subsequently, TAs visited those districts, .'reviewed " 
SITIP activities, conducted orientation/ training on models of potential 
interest.* and assisted LEA teams in developing plans for Implementation. 
During the 1982-83 school year further MSDE/LEA interactions for project 
administration for all LEAs occurred in relation to: (1) planning and funding 
for the next year, (2) coordination of existing implementation with MSDE 
training and with local" .plans to expand, and (3) ' clarification of state 
initiatives or requirements (e.g., for documentation or allocation of funds). 



*,Two LEAs chose Active Teaching, and each of the other models was selected 
by one LEA. 
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There were few Implementation planning initiatives }?y MSDE, except with 
the five "new" LEAs. In general, the focus was on maintaining communication 
(networking) so that good ideas could be shared across districts. In a few 
cases, especially where there were staff reassignments , TAs worked with SITIP 
teams or project directors to "trouble-shoot". unanticipated problems and 
modify plans. In the second half of the year, most LEAs requested TA review 
of plans or involvement in planning for implementation in the 1983-84 school 
year. Implementation Issues were influenced by findings reported in the 
evaluation of the first 18 months of SITIP. 

For the 1982-83 school year, LEAs were more involved in planning for 
evaluation . While MSDE and RBS developed "the overall design and measures, 
each LEA was required to make. decisions within the given framework. MSDE TAs 
reviewed the design with LEAs and worked with project directors or evaluators 
to clarify specific activities. Of all areas, this one created some planning 
(and implementation) problems, partly because LEA evaluation plans had to be 
revised in 1982, and partly because "ownership" and understanding of the 
design and related tasks were not clear in some cases. In general, some LEAs 
did not follow through on MSDE initiatives; they submitted appropriate written 
, plans but did not implement them. Also, in this area, some TAs were not 
strongly pro'actiye and so did not volunteer assistance until the need became 
very apparWt. by which time it was too late (e.g.. to collect data or plan 
.pre/post tests). 

Planning for training took the greatest amount of time and effort, of both 
MSDE and LEA staff. Statewide events included a three-day Summer Institute 
(July 1983) for 200 participants, a one-day Instructional Leadership 
Conference r*Iay 1983) for 500 participants (plus similar events for college 
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faculty and MSDE staff), and four model-specific follow-up meetings.* In 
addition, TAs conducted training at the request of specific LEAs. SHIP- 
related training activities (e.g., the Assistant Superintendents' Retreat, and 
site-specific follow-ups) were planned or coordinated by TAs, the ADS, and 
local staff, and similar efforts planned by other MSDE divisions (e.g., 
Chapter I Conference, URATE) involved at least one TA team 

member and required coordination with local SITIP teams. All„of these 

events required careful planning and some kind of formal or informal needs 
asse/sment, evaluation, and follow-up. Coordination among events was 
facilitated by organizational structures (including the fact that there are 
only 24 LEAs in the state), but was, nevertheless, a challenge that was 
addressed satisfactorily by the TA team. 

Across the four areas addressed (project administration, implementation, 
evaluation,. and training), arid for each of the five local groups (superinten- 
dents, assistant superintendents, evaluators, project directors, and SITIP 
teams), there. were three ways in which LEA staff participated in state-local 
planning: review. Involvement - and commitment . 

For review, MSDE shared preliminary ideas or draft documents with a 
particular group. Local input was invited and was usually given as sugges- 
tions for minor modifications. Since SITIP is voluntary, any LEA with strong 
negative reactions to tentative plans had the option not to participate. 

For involvement, MSDE invited local input during planning, sometimes as 
an informal needs assessment, sometimes through a series of discus^sions with 
individuals or groups. Local, influence on MSDE plans was strong, especially 



* The Staff Development Branch of the Division of Certification and* Accedita- 
tion shared responsibility for the Instructional Leadership Conference;^. 
Two SITIP TAs were in that Branch, which facilitated coordination. 
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for training. For instance. inforn>al needs assessment of teams might identify 
topics to be addressed and a preferred format for use of the time available. 
Then, after MSDE TAs drafted a general agenda, specific LEAs or individuals 
took responsibility for planning (and conducting) a give n session at a 
conference. TAs worked with local presenters (and outsiders) to ensure 
cohesive planning to meet stated needs. Sometimes, local involvement was 
proactive (e.g.. by the superintendents of the five "new" LEAs). 

For co mmitment . MSDE requested support through action following review 
^dl^roval_of_^^. Usually the immediate action was local planning based 

^^on-the- state mitlainv^. S^bseqUentlyTWIMentation was expected. Connnit- 

ment in the form of public support, acknowledgement, and recognition of SITIP 
successes was also encouraged during planning. Such commitment was given 
(e.g.. all superintendents of "veteran" sites participated in team presenta- 
tions at the Instructional Leadership Conference) and the general level of 
implementation of. plans was very high. 
Summary 

Planning was flexible, interactive, on-going, and based on an open- ' 
systems approach. Existing organizational structures were used or new ones 
developed to fac^itate communication and involve various interest groups in 
MSDE-initiated plkns. Within MSDE and between MSDE and the LEAs. efforts were 
made to coordinate activities and to strengthen or integrate existing programs 
with SITIP (or SITIP. knowledge bases on instruction and planned change). 
Planning was timely, ^ade good use of resources and available expertise, and 
invited local particip^ation by role groups and in such ways as to result in 
high commitment to the Ugram and real (not lip-service) implementation in ' 
almost all sites. The cWination of visible success and voluntary participa^ 
tion also facilitated planning. One particularly strong influence in planning 
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was the expertise and position of the ADS. As chair of the ICC. the Assistant 
Superintendents' Council, and the TA team he could facilitate information 
exchange, and anticipate or design ways to link SITIP and other activities. 



— Training* 

MSDE-sponsored training activities related to SITIP^^ during the 1982-83 
year included: (1) an Assistant Superintendents' Retreat, (2) an Instruc- 
tional Leadership Conference, and (3) Follow-up Workshops on each model. Each 
of those activities led to site-specific activities at some LEAs. The three 
kinds of activities are described here, participant evaluations are presented, 
and follow-up activities are outlined. Attention focuses on training of local 
educators. 

Assistant Superintendents' Retreat 

This discussion describes a two-day retreat conducted in October 1982 and 
some related activities that occurred before anrl after that event. 

Early in 1982, MSDE commissioned RBS to develop a paper synthesizing 
research on instructional improvement and planned change, organizing the 
information to address responsibilities of each educational role group ot 
"Iqvel:" teachers, school-based administrators, central office staff, and 
staff of state education agencies (Roberts & Smith, 1982). Subsequently, RBS 
staff (Roberts) made presentations on the paper to Project Basic facilitators 
and to the ICC. The latter presentation also involved Susan Loucks of the 
NETWORK, who reinforced the knowledge base by presenting a synthesis of recent 



* Each event summarized here' was described in detail in reports developed by 
RBS and submitted to MSDE soon after a given activity. Those reports are 
listed in the bibliography. , The Summer Institute conducted in July 1983 is 
described with the 1983-84 activities. 
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school improvement studies. The paper was also distributed to the LEa' 
Assistant Superintendents, who then suggested that Roberts and Loucks should 
make presentations at their annual retreat. 

Retreat activities . MSDE sponsored a , retreat for LEA and MSDE Assistant 
Superln^^^ents of^rnstructTon at the C^Tu^ mn in ColumbiaT Maryland on 
October 5th and 6th. 1982. The retreat was coordinated by Dr. Richard Petre. 
Assistant Deputy State Superintendent of Schools, and focused on recent 
research on instruction and planned change. 

The retreat was attended by 30 participants, six from. MSDE and 24 from 
the local school systems. Representing MSDE was an assistant superintendent 
or designate from three MSDE divisions, and three other staff members. 
Representing the LEAs were assistant superintendents of instruction or their 
designates from 23 of the 24 school districts. (The representative from 
Baltimore City v/as unable to attend the retreat.) 

Jane Roberts gave the first presentation on school and classroom effec- 
tiveness, which was followed by three consecutive group discussion sessions.. 
Each discussion session was led by an LEA participant who had been previously 
assigned as the discussion leader. During these sessions, participants were 
able to discuss how the information presented could be applied to the 
classroom, the school, and the LEA. The formal part of the first day of the 
retreat ended with a brief wrap-up by the conference consultants. 

On the second day. Susan Loucks made a presentation oii planned change. 
The presentation was followed by concurrent small group discussions focusing 
on practical application of the research findings to individual school 
district change efforts. The conference consultants moyed among the group 
answering questions and making suggestions and comments. The entire group 

. . ' ■ ■ 3.- ■ . 



of participants re-assembled at the conclusion of- the smm ^roup-dis^c^^^^^ 

in order to hear the reports from the group facilitators. Dr. Petre concluded 

the retreat by reminding participants that: 

• MSDE is trying to: 1) use research-based processes to implement 
schoo l^ improvement programs, 2) provide effective technical assist- 
ance, and 3) coordinate programs 

• The SITIP topic reports (which can be obtained from each district's 
SITIP project director) show where current strengths and weaknesses • 
occur in the implementation of school improvement programs 

• Supervisors need, to understand the programs being implemented in their 
district so that they can determine fidelity and change, and make sure 
that instruction is effective 

• .^,^Pg^^j^^ sc^oo^ ^^s^ ^^c^s mus t learn how to ad d programs with lea st 

effort arid maximum 



Participant evaluation . Participants were asked to state their reasons 
for attending and indicate plans for application of the information they 
received. Using a five-point scale (5.00 being most positive), participants 
also rated the effectiveness of the retreat. The reasons for attending 
perceived as most important for the highest number of participants were: 
1) the scheduled topics were of high pei^sonal interest; 2) the information 
would be useful back home; and 3) the topics were directly relevant to their 
jobs. Aspects of the seminar receiving the most positive mean responses • 
were: 1) the seminar provided knowledge that participants could use in their 
work (4.77); 2) the presentations were clear (4.76); 3) the seminar was well 
designed and managed (4.73); and 4) the' physical facilities were adequate 
(4.73). The lowest mean response was for "seminar addressed my needs',' (4.36) 
and even that was a highly positive response. In terms of future application, 
the largest proportion of respondents (52%) planned to share the materials and 
information obtained at the seminar with other staff members in their school 
district, including central office staff, principals, and/or teachers. A 
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large segment of respondents (38%) also planned to use the seminar materials 
and information to plan and implement change efforts within their school 
district in areas such as staff development, curriculum development, and 
instructional improvement. 

Most of the respondents (76%) felt that MSDE or the consultants should 
follow-up on the seminar by providing technical assistance to help school 
districts apply the information presented at the seminar to local problems 
and/or programs, or by providing additional information at a future meeting. 

The comments volunteered most often by the respondents pertained to the 
oyeralj^_semjjiaj^^^^^^^ planned , informativ e, wor thwhile), to the speakp>rs 



(excellent presenters) , and to the topic (good topic — appreciated getting 
back to instruction as a major topic). In general, the retreat was 
perceived to be a success. 

Subsequent related activities . Three kinds of activities occurred in 
relation to the retreat: for LEAs, at the state level, and among TAs. 

Three LEAs invited the RBS speaker to repeat her workshop session for 
administrative and supervisory staff. ? 

• In Washington County, RBS staff conducted training for central office 
supervisors and school principals, and worked with.,LEA staff to 
develop videotapes for teacher inservice. Local educators formed 
study groups to explore some areas (e.g., time-on-task) in more detail 
and plan appropriate applications. This reinforced several county 
instructional improvement efforts. and may have influenced the county's 
decision to implement Mastery Learning in the 1983-84 school year. 
(STL was implemented during 1980-83 with SITIP funding, and AT was 
implemented during 1982-83 as part of another project. Both will 
continue through 1984.) 

• In Harford County, RBS staff conducted training for elementary school 
principals and some central office staf^f. This reinforced and 
elaborated SITIP. activities since Active Te^axihing is implemented in 
all elementary (and some middle) schools in Harford. 

• In Prince George's County, RBS staff conducted training for all 
secondary school principals and some central office staff. This 
reinforced the county's efforts to train principals as instructional 
leaders. 

^ ' 4d 
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Two other LEAs, St. Mary's and Wicomico, requested further Information and 

-■ . . / 

made arrangements for SITIP linplem-nters to attend workshop sessions conducted 
by RBS at the beginning of the. 1983-8.4 school year. 

At the state level. Chapter I staff decided to focus on Instructional 
Improvement for their annual conference, and Invited RBS staff to assist them. 
The Roberts and Smith synthesis paper was used as advance reading material and 
RBS staff presented workshop sesslDns, The Chapter I conference, held In 
January 1983, was attended by LEA Coordinators, some assistant superlnten-- 
dents, and some central office supjervlsors. Participant evaluations were 
positive. ' 



All SITIP TAs reviewed materials used at the Assistant Superintendents'' 
Retreat, and discussed the knowledge bases with RBS staff. They Incorporated 
information and materials Into their own follow-up training, and coordinated 
SITIP activities with other local and state efforts to apply the shared 
knowledge base on Instructional improvement. 
Instructional Lead-ershlp Conf erence(s) 

This discussion describes three Inter-related conferences conducted In 
May 1983: for local educators, MSDE staff, and college faculty. While most 
conference planning and management tasks were carried out by the SITIP TA team 
and staff of the Certification and Accreditation Division, the conferences 
were sponsored by the ICC and- considered a joint effort of Instructional 
divisions; ^ - 

The four original orientation sessions for SITIP, held In 1980-81, 
brought nationally-known speakers to address an audience of cross-hierarchical 
teams. Speakers also addressed MSDE staff on separate occasions. The events 
were successful, so In 1982 an Instructional Leadership Conference was 
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conducted at which Barak Rosenshlne and Bob Bush made presentations. Again, 
audience reactions were very positive and a 1933 Conference was planned with 
activities coordinated across MSDE divisions in order to meet various - rogr 
interests. — — — 

The main 1 983 conf erence was" des ig^^^^^ 
one speaker (Madeline Hunter) spent a day and a half with over 100 college 
faculty, and she and Karen Louis also spent a day with MSDE staff. The three 
training activities all focused on the same knowledge base, but emphasis and 
process varied to suit audience needs. 

r 

activities. On Mav 1983, the annual Instructional Leader- 



ship Conference was held at College Park, attended by approximately 500 
participants, most of whom were local educators. The objectives were: 

• to review research on the processes of planned and managed instruc- 
tional improvement ' . 

• to learn the results from 19 Maryland local education agencies which 
have implemented planned change in SITIP (School Improvement Through 
Instructional Process) for the last two years 

• to consider facilitating quality in teacher effectiveness. 

The first objective—planned change for instructional improvement— was 
addressed by Karen Seashore Louis of the University of Massachusetts. The 
second objective— SITIP implementation— was addressed by LEA teams, introduced 
by their respective superintendents in a series of . concurrent small group 
sessions each lasting 45 minutes. The third obj ective— teacher effective- 
ness—was addressed by Madeline Hunter of the University of California. Both 
outside speakers addressed the total audience, each speaking for one and a 
half hours. 
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All participants received as advance reading materials: "Instructional 
::iprovement : A System-Wide Approach" (Roberts & Smith), and "The Science of 
che Art of Teaching" (Hunter). Most LEAs provided small-group participants 

c 

with handouts describing their SITIP activities , and some also used other 
visuaT aids "iri~^^^ 

Louis' presentation was straight-forward, with some references to SITIP 
but few asides or anecdotes. Louis addressed three main topics: (1) current 
trends in school improvement and school effectiveness; (2) assumptions and 
strategies, of planned change; and (3) planning dilemmas. 

Each local SITIP presentation was introduced by the LEA superintendent 
or a designate, and conducted by a team of local educators. All presentations 
included reference to the MSDE-sponsored activities for initial team training 
and subsequent follow-up, and also outlined the model. Usually, central 
office staff provided introductory and background information; principals 
summarized the implementation process or reviewed evaluation findings; and 
teachers described actual classroom experiences. . 

Hunter's presentation was relaxed, and included examples and anecdotes to 
illustrate key points. She talked about how to produce an effective school, 
and discussed three kinds of knowledge: (1) propositlonal — what; * (2) 
procedural — ^how; and (3) conditional — when and why; emphasizing how most 
teaching centers on prbpositional, with,< little concentration on procedural, 
and hardly any emphasis at all on conditional knowledge. Hunter also reviewed 
three decisions made by educators that strongly influence effective teaching. 
These decisions are: (1) the content to be taught, (2) the behavior of the 
learner, and (3) thu behavior of the teacher. 
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Participant evaluation. Participants r^ed presentations and the overall 
conference on a fivT-point scale (5.00=.excellent) . They were asked to off-.r 
negative or positive .eonments and to indicate future needs or plans. 

Mean ratings for presentations are presented in Table 5. They range 
^^"^^^ ^•^^ ^""^ 3.93 for Louis and 4.73 to 4.87 .for Hunter. Respondents 
considered Louis' presentation to be average to good and Hunter's presentation 
good to excellent. Of the 63 positive statements made about Louis' presenta- 
tion, 22 commented on the speaker's expertise and general knowledge of the 

'I 

content, and 21 considered the presentation well organized. Of the 100 
negative statements, 64 considered Louis' presentation too long, and 19 
criticized the delivery. Of the 75 positive statements made about Hunter's 
presentation. 21 commented on the speaker's content knowledge, and 17 enjoyed" 
the delivery. Of the 10 negative statements. 3 wanted more time, 3 related to 
facilities (poor amplification), and the otliers found the content simplistic 
or inappropriate for their needs. 

Both rounds of LEA, presentations were considered by the respondents to be 
of "good" quality as evidenced by the overall mean ratings on all seven, 
evaluation items of greater than 4.00. Within each topic (AT, ML. STL. TV), 
the ratings averaged across the role groups on the seven evaluation items were 
all greater than 3.00 (average). Mean ratings tended to be lowest for TV. and 
highest for AT and Ml". Of the 51 positive comments volunteered by the respon- 
dents. 24 enjoyed the speakers (varied, enthusiastic, ceacher involvement in - 
presen^ta^ns) and 10 appreciated the quality of the content. Of the 35 
negative co^ents about the LEA presentations. 22 respondents mentioned the 
facilities (crowded, bad accoustics. difficulty seeing), and 5 commented on 
the content (too much, inappropriate, not new). 
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Table 5 



Mean Ratings for Presentations: 
Instructional Leadership Conference, 1983 



Objectives 




1 


LEA 


Sessions 


Louis 


Hunter 


Round 1 


Round 2 


^ Clarity of. objectives 


3.93 


4.75 


4.33 ' 


4.18 . 


Relevjance of objectives 


3.67 


4.73 


4.17 


4.07 


Attainment of objectives 


3.58 


4.77 


4.23 


. ^-11 


Quality of content 


3.56 


4.80 ' 


4.25 


4.13 


Quality of presentation 


3.09 


4.87 


4.28 


4.19 , 


Quality of overall activity 


3.26 


4.81 


4.18 


4.05 


Quality of materials 






4.05 


4.07 



Responses can range from 1.00 (poor) to 5.00 (excellent). 
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For the overall conference, all five evaluation items received mean 
ratings of 4.00 or above, indicating that the respondents judged the confer- 

\ 

ence to be of "good" quality. Of the\50 positive comments volunteered bj>/ 
respondents, 29 related to the speakers, with most appreciating LEA presenta^ 
tions (14) or Hunter (11). Ten respondents appreciated the quality of the 
content, and nine liked the design (balanced use of time, session choices, 

etc.). \0f the 43 negativje comments, 18 criticized the facilities for small 

\ 

group sessions, and 13 related to the speakers. 

Table 6 " . 

Mean Ratings for the Instructional Leadership Conference Overall (1983) 



Obj ectives 


Mean Rating 


Quality, of advance reading materials 


^4.. 12 


Quality of conference design 


4.08 


Quality of the facilities 


4.21 


Quality of the overall conference 


4.10 


Value of the conference 


4.04 



Responses can range from 1.00 (poor) to 5.00 (excellent). 



Respondents were asked to indicate future actions. The largest percent- 
age of respondents (7 P. 4%) indicated that they would discuss further with 
their colleagues the information that they gained from the conference. Only 
5.8% of the respondents did not have any future plans. 

In general, the conference was successful, particularly the presentation 
by LEAs and Hunter. While the content of Louis' presentation was valuable, 
participants reacted negatively to her delivery, which, in comparison to 
Hunter, was perceived as « dry and academic. 



Related activities . The conference f or| LEAs was flanked by two similar 
conferences, one for faculty of colleges of higher education, and the other 

for MSDE staff. \ 

\ \ 

The former was held at Towson State College, consisted] of one-and-a-half 
days of sessions conducted by Madeline Hunter,' and was part of the URATE 
series. The content was the same as that discussed for the LEA conference, 
but Hunter went Into more detail and also engaged participants during question 
and answer sessions. The conference was well received, and several of the 120 
participants stated that they would Include Hunter's Ideas In their courses 
(teacher pre^ervlce) . 

The conference for MSDE staff was part of the professional staff develop- 
ment program, and Involved both Hunter and Louis who were asked to use the 
same knowledge bases as they had for the LEA conference but to focus on 
Implications for state policy and practice. Each speaker was scheduled for 
one three-hour general session and for two or three one-hour consultation 
sessions with specific groups or divisions. 

Hunter addressed a large group from many divisions for her general 
session; two separate groups of five to eight each from the Divisions of v 
Instruction and of Compensatory, Urban and Supplementary Programs (CUSP); and 
approximately 20 staff fror- Special Education. Her general pres.entatlon was 
basically the same as that given for the LEA conference. Consultation 
sessions followed a question/answer format and Included discussion of Instruc- 
tion, curriculum, use of class time, student grouping, and provision of 
technical assistance. 

Louis addressed 21 staff from five divisions for her general session, a 
group of six staff from CUSP, and five SITIP TAs In separate consultation, 
sessions. The general session expanded on the LEA conference presentation, 



and the consultation sessions focused primarily on provision of technical 
assistance. All three sessions engaged participants In discussion. Key 
points made Included: 

... ^,;\ 

• SEA staff sometimes also provide technical assistance which is In- 
person action to help local educators make decisions or behavioral 
changes related to their own perceived needs or goals. TA assumes 
that local educators make choices. TA Is not a "solution In search of 
a problem." Good TAs tend to Identify with their clients. 

• Monitoring and TA should be separate roles. If they are combined, 
strategies must be used to "switch hats." 

• TAs spend 10% to 100% of their time in the role. 

- 10% - 20% makes relatively little Impact 

- 40% - 50% is minimum if time is to be, protected from other 
responsibilities 

- 80% - 100% is ideal for effectiveness. 

Low (off Iclal) time allocations Increase Incumbents' stress, 
especially If the role is not legitimized as part of a job description 
with appropriate accountability. 

• When TAs have little time in the role, or many sites to cover, it is a 
good idea to use the tine to help the LEA stay on track, usually by 
working closely with a local champion or energlzer who has enough 
Influence to get things done. A 10%. SEA TA and a 10% LEA energlzer 
(at each site) add up to less than 20% since the MSDE TA is working 
with several sites, and both TA and energlzer get pulled from the 
program by other responsibilities. 

0 

• . When the^program/lnnovatlon is a real local priority It is easier, and 
local dependence is less. 

• Other "facilitators" Include: TA knowledge of LEA norms; LEA under- 
standing of SEA staff roles and program priorities; earned familiarity 
of individuals (credibility/trust, LEA confidence that TA really will 
help); shared successes; careful planning with on-going checking of 
the areas suggested by the "theories in use" matrix (especially 
political and systemic contextual Influences as the program gets 
underway) . 

• "Barriers" Include: lack of understanding or belief in the TA role 
by LEAs or other MSDE staff; loss of linking /bonding mechanisms if 
positions are "RIFed" or individuals change jobs. 

• Instltutionalizatioh arises through cycles and passages. 

- A cycle is a series of related eveuis e.g., a champion leaves and 
new person takes over. If the new person is a champion in name 
only, or if there is no new appointee, there may be "underground" 
program use, but no institutionalization; but if the new person 
takes hold institutionalization is more likely. 
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- A passage is a change in program status, e.g., a change in the 
funding base, a shift from a, pilot to- a project, or broader 
implementation. 

Each major decision, is crucial. While institutionalization is not 
guaranteed, the more cycles and passages which occur, the more likely 
that a program will survive. If something is "hard to undo" it's more 
likely to be institutionalized, e.g.,, rather than a single pilot site, 
if there is pressure for success by teachers (and°"others) rather than 
by lonely advocates or uncommitted staff. 

• When outside funds stop, LEAs" will continue a program if they perceive 
it as having subjective and/or objective value. If they have accepted 
funds ojit of opportunism, .or if they find a program such as SITIP as 
having little value, they probably should let that program die. 

• SEA may hope that LEAs will learn how to apply planned change. research 
and build capability to repeat the process. That's rarely true, it 
happens only when an LEA experiences it several times. SEA TAs can, 
over time, build local capability in planned change. 

Participants rated the effectiveness of the presentations and consulta-- 
tion sessions, with mean ratings ranging from 3.59 (quality of Louis » general 
presentation) to 4.75 (quality of Hunter's general presentation) on a scale of 
one to five (5.00-excellent) . Overall, the conference was perceived to be in 
the good to excellent range, In general, most participants stated they were 
likely to take one of . the following three actions as a result of the 
conference: 

• use in inservic'e/staf f development 

• incorporate into program planning or policy-making 

• discuss further with colleagues. 
Follow-Up Workshops 

This section describes follow-up workshops conducted by TAs during the ' 
1982-83 school year. 

The SITIP design provided for follow-up training each year for 
implementers of each model. The purposes of such events are: 

• to facilitate networking by bringing LEA teams together to exchange 
information * 



• to reinforce, clariky. 6r expand knowle^dge and skills needed to 
.implement; the model i\> ,\ \ 



.• to meet needs identified local team members, including the main- 
tenance of ,a support group and the continuing development of an 
up-to-date knowledge base. 1 - . . 



Each TA team had access to funWs (up to $2000 per model) and was free to 

\ ■ ■ \ ' ■ 

use members' own judgement in designing ' activities suitable for the above 

purposes. One collaborative follow-up session was conducted and alj. others 

\ 

were model-specific and independently developed. 
Follow-up events included: . 

• Joint meeting: AT, STL, TV, September 16, 1982 at MSDE 

• ML; September 28-29. 1982 at Harpers Ferry (near Frederick County) 

• STL, October 22, 1982 in Charles County 

• STL, Marc'i 24-25, 1983 in Worcester County 

• AT, May 17-18, 1983 in Kent County 

- Joint mee ting. The TAs of three models-AT, STL, and TV-collaborated 
to conduct a one-day joint meeting at MSDE in September 1982. It was 
attended by 41 local educators representing 18 LEAs and addressed the 
following topics: - 

• yRATE~(by C & A Division staff) how. LEAs and colleges could exchange 
information or coordinate activities for mutual benefit. 

• Evaluation— (by RBS staff) findings and reports for the 1981-82 year 
and requirements for local involvement for the 1982-83 year. * 

.. • Updates--(by TAs) model-specific discussions of recent LEA activities 
to sITIp! upcoming year, including welcoming "new" LEAs 

Participant racings were positive, with all m^,,, #u.ve 3.69 (on a five 
point scale where 5.00=excellent). The update^sesslons -were_per-ceiv«d-as-.most- 
useful by participants, although several also appreciated the information on 
the evaluation design and measures. While participants liked the idea of 
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sharing information with college faculty, their interest and energy focused 
more on their ovm implementation needs. For future TA activities, partici- 
pants expressed needs in the following areas: training (1 LEA), dissemina- 
tion/ expansion (3 LEAs) , evaluation (2 LEAs) , general support and resources (6 
LEAs), and coordination with college preseryice (1 LEA). \ 

Active Teaching. A two-day retreat was^ conducted at Great Oaks Landing, 

Kent County, in May 1983, attended by 33 local educators representing iix 

■ \ ' ■■' ' \ \ ' \ 

LEAs. Objectives included: increased awareness nf activities\ in other AT 

counties, increased \familiarity with research on classroom management, and 
ability to conduct classroom management workshops for teachers.\\ Activities 
included: \ \ \ \\\ 

' \ ■ ' ' 

• Comparative review of instructional strategies-^AT (by Thomas Good) 
and similar designs by Rosenshine, Hunter, and Stallings TCby the AT 

TA) \ \ ■ \ ■ 



• LEA progress reports and plan8--by each AT team 

• Classroom management (by Barbara! Clements of the R&D Center at the 
University of Texas)~presentation8 and participatory activities, 



Participant ratings were positive, with means ranging from 3.39 to 4.57 
(on a five point scale where 5 . 00=excellent) and evaluation! commentls 
indicated that most people most enjoyed the handUuts provided and the group 
involvement activities. Future needs expressed by participants related to 
training and assistance (particularly teaching/ learning "how tos") , dissemina- 
tion/expansion, evaluation, and general support and resources. Most expressed 
needs were made by p£'r:t-.icipants from Cecil County. 

Mastery Learn. xue ML TAs conducted a tv -u. y S^creat at Harpers 

Ferry (near Frederick County) at the end of September 1983. It was attended 
by 30 local educators representing six ^^EAs. (The seventh LEA sent represen- 
tatives only for their own presentations.) The agenda-^content and process- 
Was designed to meet m-ds specified by participants in a pre-conf erence 
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survey. Sessions on corrective and enrichment activities (by an outside 
consultant), on staff development (by TAI) , and on testing (by LEA staff) were 
conducted for the total group. All others were small group concurrent 
sessions organized so that each participant attended at least four such 
sessions. , . ' 

Topics addressed included: 

• Designing and managing corrective and enrichment activities and 
analyzing and assessing prerequisite and component skills (by Walter 
Thompson. Mastery Learning Corp.)-two formal presentations plus large 
and small group question/answer sessions 

• l^fi development and coordination of inservice and preservice (by 
C & A Division staff person and TAI) -small group presentation and 
discussion 

• Evaluation (by RBS staff ) -small group presentation and discussion 
of results of the first year study and requirements for local 
involvement in the second year 

• piesenJatSon" ^""^ community (by Allegany staff) -small group 

• Assisting new schools (by Baltimore County staff)— small group 
presentation and discussion 

• ^^^^n^ successful implementation (by Worcester and Howard county 
staff)— concurrent small group presentations 

. Staff development (by TAl)~presentation of relevant research to total 
group, and a small group presentation by Baltimore City staff 

• Initiating^ML (by TA2) -presentation of open systems planning and 
implementation research to a small group . 

• ^^l ^^^""'"^^ City assistant superintendent) and 
testing what is taught (by Aane Arundel staff) -presentations and 
participatory activities for the total group 

. Project .review and planning for two groups-kdministrators and 
teachers. 

y " . 

Participant ratings were positive, with means all above 4.05 (on « five 
point scale where 5 .00=excellent) and evaluation comments indicated that most 
people most enjoyed the formal and informal sharing among LEAs, and the 

52 

6i 



ERIC 



sessions on testing. With the exception of sessions conducted by Thompson, 
all sessions held participants' attention. Thompson followed his own agenda 

o 

which was not wholly responsive to expressed needs of TAs and participants. 
For future TA activities, participants expressed needs In the following areas: 
training (3 LEAs) , dissemination/expansion (4 LEAs) , evaluation (1 LEA), 
general support and resources (4 LEAs) . 

Student Team Learning . Two foilow-up sessions were held, the first 
(October 1982) hosted by the STL pilot school In Charles County, the second 
(March 1983) held In Ocean City and Including site visits to pilot schools 
In Queen Anne's and Worcester. Only the second workshop Is described here. 

The^ STL Spring Follow-up was attended by 52 local participants who 
spent most of the first day visiting classes using STL at Queen Anne's High 
School, some of the second day observing STL classes at Showell Elementary 
In Worcester County, and the rest of the time In total group and small group 

c . 

sessions conducted at the Carousel, Ocean City. Topics addressed Included: 

• LEA progress reports and plans — by each STL team 

• Planned change and the SITIP designs (by RBS staff) — presenta- 
tion and participatory activities. 

• STL Implementation (by STL developer) — brief comment on 
local successes. 

Participant ratings were positive, with means ranging from 4.15 to 4.49 
(on a five point scale where 5 .00=8Xcellent) , and evaluation comments 
indicated that most people most enjoyed site visits to observe STL used In the 
classroom. Needs expressed for the future Included Information and leadership 
in project continuation and expansion, and general support and resources. 
Both sets of needs were mi^fP'^^^i%d in ways suggesting that they should 
addressed by . LEA teams ratl.^i than MSDE. However, there was some evide ;o 
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that MSDE TAs would need to help LEAs in maintaining momentum, in networking 
among schools and districts, and in maintaining fidelity and scope and c 
intensity of STL implementation. ■ " 

Summarir. Each of the Follow-up sessions led to further communication 
between some LEAs and the MSDE TAs. In several cases, especially for "new- 
counties, TAs conducted site-specific workshops, sometimes assisting local 
coordinators, sometimes directly conducting training. Also, since two TAs 
(for ML, and TV) are in the MSDE Staff ■Development Branch their knowledge of 
SITIP models influenced content of workshops and training institutes they 
conducted for principals and others not directly involved in SITIP. 

It is apparent that each Follow-up session addressed the general purposes 
of such events and satisfactorily met participant needs. It is interesting to 
note that in all cases LEA progress reports were given, an outside consultant 
conducted at least one session, and both formal presentations and participa- 
tory activities were included. This mix of activities appears to have been 
well-received, and participants particularly liked learning about others' 
activities-the more first-hand the better as is apparent from the STL site 
visits. If outside consultants were involved they were more successful if 
they attended to the guidelines negotiated with the TAs (all of whom seriously 
addressed the needs and interestsof local participants). The TA attitude 
(and resulting behavior) that local.needs for effective program implementation 
provide the basis for Follow-up activities, was apparent in all cases and 
evident to participants who responded positively by their contributions in 
progress reports and small group^ activities . The networking (affective and 
informative) resulting from the Follow-up sessions has contributed to the 
goodwill among LEAs and between MSDE and the LEAs, and has stimulated quality 
implementation and some expansion in the LEAs. 



Sunanary 

Training was designed for cross-hierarchical teams, was directly related 
to implementation of the SITIP models, included information ,and. activities to 
reinforce content and process, took into account participant needs and 
interests, involved local teams as presenters, involved outside consultants as 
presenters (carefully coached by MSDE TAs) , and was provided on the under- 
standing that MSDE would provide assistance for LEAs wishing to follow through 
ideas with a larger number of local educators. The various kinds of training 
events reinforced each other, and MSDE also tried to establish a common know- 
ledge base for all hierarchical levels. Communication among TAs and through 
the ICC facilitated coordination, and influenced training designs and content 
that reinforced application of research-based instructional improvement and 
yet did not result in redundancy. 

Participant evaluation of events and the subsequent local requests for 
on-site presentations and assistance provide strong evidence of the value to 
participants of the SITiP^related training provided by MSDE. 

Te chnical Assistance 
As stated previously, assistance to LEAs was provided by an eight-person 
team under the leadership of the ADS. The team carried out planning and 
training activities described earlier in this chapter and also worked in dyads 
to provide jnodel-specific assistance to local implementers . This section 
describes the technical assistance (TA) system, roles and responsibilities, 
and impact. 
The TA System 

The ADS provided leadership, allocated resources, and encouraged volun- 
tary acceptance of tasks to be done. He chaired monthly meetings (usually 
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lasting one or two hours, but with one annual full day session), and 
coordinated activities across models. While he encouraged each TA dyad to be 
program-oriented and autonomous, he made suggestions and set limits when plans 
or activities did. not seem to be SITIP-centered (e.g., overly ambitious ■ 
training designs or dissemination plans). 

The TAs were drawn from various MSDE divisions. At the beginning. of the 
school year there were: two administrators from Project Basic; two staff 
development staff - a branch chief and a consultant from the Certification 
and Accreditation Division, (plus a third person who was delegated only to one 
ML county); two instructional staff - a branch chief and a mathematics 
specialist from the Division of Instruction; and two program specialists one 
each from the Division of Library Development' and Services and of Compensa- 
tory, Urban and Supplementary Programs. • 

For each model two TAs were assigned. For the 1982-83 year some changes 
occured: 

• • For AT, the instructional branch chief TA participated at a low level 
f^thf ^i^'^^TA^r ^l!""^? ^^'^^"•ber, then handed over responsibilities 
to the other TA (mathematics specialist) , who was allocated (some) 

sSeci^?! t?""' f^^^ 1983, a new TA (also a mathematics 

specialist) was assigned to share the work load. 

* IZr^u ^^"'^ ^ delegate for one county) continued through the 
year, but primary responsibility was exchanged with the program 

cMef ?n ''^o'S? l^'^r '"^'""'^ °' ''''' development branch 
chief. In June 1983 one TA (in Staff Development) handed over 
responsibility to a new TA (in Instructional Television). 

* 9^^?"^%°"^ retired. A new TA (from the same division ~ Library 
Services was assigned, with responsibility to support all models 
(materials and relevant research-based information), whill the 
administrator TA took responsibility for all tasks related to STL 

* !nn ^rll TAS continued with SITIP, proposing to share work 

ef?oii'';han .f. ^^^^ administrator TA invested somewhat more 
ertort than did the staff development TA. 
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The TA system was loosely-coupled, decentralized, program-oriented, and 
made up of highly-autonomous members held accountable for maintaining produc- 
tive working relationships with tEAs. As long as local feedback to the ADS 
(e.g., from LEA assistant superintendents, ICC members, or PBS evaluators) was 
positive, each TA was free to use his/her own judgment. 

When a TA needed assistance (usually recognized by the TA) he/she asked 
for and received help from another team member, including the ADS, and members 
were well aware of each other's strengths.^ Thus, the TA system provided 
support for its members, and coordinated administrative and logistical 
planning, communication, and resource allocation. While TAs worked as a team 
to plan Leadership Conferences and the 1983 Summer Institutes, and to ensure 
consistent and appropriate communication to LEAs about SITIP (e.g., planning 
and evaluation requirements, resource a3 locations) , they did not work together 
for delivery of assistance to LEAs. The assignment of the TA from Library 
Services to provide support to all TAs appeared to be a good idea initially. 
However, such support was not needed by TAs (each preferred to build his/her 
own knowledge base and maintain specific resource files) , and the incumbent 
was not integrated into the TA system. (This reflected primarily on systemic 
needs and established patterns of behavior rather than on individual capabi- 
lities: the job assigned was not perceived by TAs to be needed, and other 
people continued to carry out the tasks) . The one weakness of the system, 
identified by its^members, was that the small amount of time available for TA 
meetings had to be spent on central management tasks, and TAs would have 
preferred to spend more time on program tasks, building their capacity by 
learning from each other (e.g., content and knowledge base of the models and 
strategies and anecdotes of processes of planned change) . 
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The constraints of time did not relate only to formal TA meetings but 
also to delivery of services to. LEAs and to general administrative tasks. 
Administrative tasks e.g., collecting PEPPS forms or evaluation surveys, were 
unpopular, and most coordinating functions were undertaken by the administra- 
tor assigned to STL. In general, as a team and within each dyad, TAs made 
appropriate arrangements to get the work done, usually without Interpersonal 
conflict and without things *'f ailing through the cracks." Quality and 
quantity of work done were Influenced by TA perceptions, by the level of 
effort invested in specific tasks, and by organizational arrangements within 
each dyad. 

Roles and Responsibilities . ^ 

While all TAs agreed that their responsibility was to help local 
educators implement the models selected according to LEA plans, each dyad 
defined that responsibility slightly differently. Here, roles, rewards, 
challenges, and tasks are discussed for the whole team with references to 
model dyads. 

Role. With the exception of the person designated to provide general 
support, TAs believed that the assistance role included: coordination of 
networking among LEAs using the same model; on-site visiting to aclcnowledge 
fidelity use; training and coaching; trouble-shooting; and information giving. 
They differentiated assistance to ^'veteran" LEAs (encouraging independence) 
and *'n^w". LEAs (building trust, training). They unHe^s^ood their value as 
outsiders in crossing hierarchical boundaries within ap LEA, and were some- 
times frustrated when their help was not sought (and some TAs were trying to 
be less proactive with "veteran" sites hoping that local educators would have 
learned what help to request). 



Differences among TAs resulted in four different dominant role sets: 
— trainer/coach; ML — consultant/trainer; STL — observer/networker; 
TV — information linker/ trainer, These differences were influenced by 
personal style and preference (e.g., AT and ML) , by the nature of a model and 
relative availability of developers as trainers (e.g., STL), and by the number 
of "new" LEAs and of "veteran'i^I^s in which training was done to encourage 
expansion (e.g., AT, TV). ^ 

Rewards . Role definitions were influenced by individual TA's motivation 
or perceived, rewards. While all TAs were gratified by project successes and 
by. specif ic "growth" of activities or people in LEAs, each of the six active 
TAs had a different emphasis in terms of personal rewards. 

• program focus: "I want to see it work because it works" — the 
excitement of facilitating a worthwhile instructional program (1) 

• . professional growth: "l understand the conceptual knowledge bases " 

now. I've become an expert, and can use what I know in SITIP and in 
my regular role. I'm accomplishing something." (2) 

• "people" orientation: "I enjoy watching people grow, and the inter- 
active support among role groups. I like networking." (2) 

• personal growth* visibility, working with highly competent people:, 

"I like the direct involvement with a school improvement project." (1) 

Challenges . Regardless of the perceived rewards, all TAs experienced 
common challenges. Conflictin g demands — SITIP vs. regularly assigned ' 
responsiHlities — required TAs to make choices. The most obvious choice was 
made by the two branch chiefs who gave up their Sitip' roles, one in December, 
the other in June. They both argued that role conflicts — management vs. 
program — of their regular duties and SITIP TA were too gireat, and (somewhat 
reluctantly) they opted' for those responsibilities for which they were more. ' 
formally held accountable. Most other TAs looked for ways to combine SITIP 
with their regular duties.' For instance the mathematics specialist integrated 



SITIP and regular tasks- relating to his subject area and piggy-backed site 
visits with other field work. Other TAs did similar things but without the 
subject area focus. Attempts to balance (rather than- integrate) roles were 
less successful, partly because the official allocation of 10% time to SITIP 
was insufficient* and sometimes because the "regular" role responsibilities 
were highly demanding or very different from TA responsibilities. This- 
conflict raised a question about the reality of priority status awarded SITIP 
"If SITIP 's so important, -why doesn't my supervisor recognize that?" Coping 
behaviors — when integration and balancing did not work — included: 1) 
investment of time (evenings and weekends) , 2) fire fighting — attention to 
'immediate "loud" crises or needs, usually relating to the "regular" role, and 
3) fast fakes — relying on existing experience rather than developing 
specific expertise, usUally relating to the TA- role. 

i Other„ challenges pertained to state/local relationships , straff reassign- 
ments, and use of resources: The relationships challenge occurred when a TA. 
sincerely wanted to provide assistance in a client-responsive manner, but the 
LEA suspected that all MSDE staff wanted to enforce iraplementation of their 
own ideas and programs. .Also, in some cases LEAs seemed to think that they 
could accept SITIP funds without actually carrying out the plans they had 

s of local perceptions had a historical basis and TAs 
sometimes found It difficult to convince local staff that the plans were to be 
Implemented -and TAs could help. (This kind of challenge was encountered for 
all models, but not always recognized soon enough by TAs, especially when a 
project coordinator, "told' a good story." 

A second kind of challenge occurred when key staff were reassigned . For 
instance in Calvert (AT and STL) , Garrett (AT) , and Kent (TV) , project 
coordinators and/or energizers (program advocates) were reassigned, program 
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activities faltered, andTAs needed to provide additional help in training, 
coordination, and communication. They also needed to try to persuade local 
SITIP teams to spread expertise (build an organizational knowledge base) and 
encourage more involvement and commitment of central office staff, rather than 
rely on a single trainer/leader. When school-based staff were enthusiastic, 
TAs were sometimes tempted to "skip over" central "off ice staff. Though they 
did not do so, they were frustrated by instances of disinterest arid seeming ■ 
unwillingi^ess of central office staff (new to SITIP) to support school 

implementation of the program. X 

■ . \ 

The third challenge related to resources . While all TAs would have liked 
more money for follow-ups, e.g.. to pay nationally recognized presenters or 
overnight expenses of participants, only two TAs considered lack of resources 
or resource use as a challenge. One argued that LEAs implementing the more" 
complex models (e.g., ML) should receive more funds (regardless of the imple- 
mentation strategy or scope);' the other was concerned that SITIP projects did 
not make use of such resources as MSDE audio-visual materials or school media 
centers (Including micro-computers). Neither challenge was • addressed. 

Tasks. The ten task areas originally identified were also addressed 
during the 1982-83 school year, although time allocations changed, and some 
areas were slightly redefined. During the seven months ending June 1982, TAs 
spent about 175 days on SITIP, addressing the task areas of : (1) administra- 
tion and budget (5%), (2) planning (3%), (3) knowledge building, (4) materials 
identification or development, (5) training (22% which included time for tasks 
#3 and #4 which were perceived as directly related to training), (6) general 
support (10%), (7) site visits (40%), (8^.) evaluation (4%), (9) communication 
(10%), and (10) dissemination (6%). 
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During the 1982-83 year these task areas were characterized as follows 



• Administration and budget consisted primarily of distributing 
and collecting forms from LEAs relating to funding and to 
local participation In -SITIP training events. It also 
Included record keeping of various kinds. With one exception, 
no TA spent more than 5% of his/her SITIP time on this task 
area. The exception ~ the STL TA ~ spent 35% of her SITIP 
time (14 days) on this (partly because her "regular" role as 
assistant to the ADS made It simpler for her to do the work 
than for the others), 

• Planning Included activity among the TAs during monthly . 
meetings to design upcoming events such as the Instructional 
Leadership Conferences, or liaison with URATE, Interaction; 
with T^EAs (especially "new ones") related to planning and 
completion of PEPPs forms, planning for their follow-up 
training events. With one exception no^TA spent more than 10% 
of his/her SITIP time on planning. The exception — one of 
the TV TAs — spent 25% of his SITIP time (8 days) orf planning, 
focusing primarily on arrangements for the Summer Institute, a 
responsibility he undertook since It required expertise he 
used in his "regular" role in staff development, 

• Knowledge building consisted primarily of developing expertise 
in application of research on planned change and. one or mere 
SITIP models. Four TAs spent between 10% and 20% of their 
SITIP time (up to 8 days) on this, while the others spent less 
than 5%, While the newly assigned TA was expected to invest 
time ktiowledge-building, the behavior was unexpected for the 
other three. However, all three stated that they had read 
widely, thoroughly understood the relevant knowledge bases,, 
used that knowledge in their "regular" roles, and — as was 
apparent in their training and assistance activities — they 
developed materials and strategies relevant to local needs that 
demonstrated that expertise. One said, "l understand the 
concepts now — I own that knowledge." 

• Materials development/ identification work was greatest for TV 
training (15% of one TA's SITl^ time, about 10 days) and 
minimal for other models, 

• Training included both conducting workshops in LEAs and at 
model follow-ups. Five TAs conducted training, with two of 
them spending about 25% of their SITIP time (12-24 days) on 
the activity, and the others spending less than four days. 
Almost all LEA training conducted by TAs was for "new" sites 
or where the local energizer had been reassigned. Training by 
TAs was needed less for STL and TV since several LEAs 
contracted with model developers to provide assistance. All 
on-site training conducted by TAs was in support of local 
educators and was linked to follow-up assistance and school 
site visits. 



General Isupport included over-the-phone assistance, networking 
sites^wit^h common ne*eds or interests, and sharing informatibn. 
Each lea,d TA spentlbetween 5% and 10% of SITIP time on thils 
activity (between twd and seven days). 1 



» Site visit^ were cond,\cted by six TAs, each spending betweei 
two and eleven days (10% to 40% of their SITIP time) . The l 
objective was for each LEA to be visited twice, with more 1 
visits for "new" sites. Specific purposes varied, and 
included: \ . { 

- monitoring ^fidelity of implementation 

- recognizing/acknowledging teachers' accomplishments to 
resolve problems 

- participating in cross hlera'rchical team meetings to 
review progress and determine next steps' 

- working with project coordinators to design training, 
develop implementation plans,' or determine how to overcome 
barriers 

- building working relationships and mutual trust at all 
hierarchical levels so that the model could be 
implemented. 

• Evaluation was conducted by RBS but TAs determined criteria 
for the design, informed LEAs of their responsibilities, 
clarified RBS guidelines, helped LEAs develop evaluation 
plans, distributed and collected surveys and reports, and 
arranged for RBS to visit pilot sites. Four TAs contributed 
to evaluation tasks, each investing between two and five days 
(5% to 10% of SITIP time). 

• Dissemination took up to 15% of a TA's SITIP time (from one to 
14 days) and included: assisting LEAs develop presentations 
for the Instructional Leadership Conference (May 4) : referring 
to SITIP or making SITIP-related presentations to key interest 
groups such as the ICC, professional associations, or at 
training academies; resppnding to requests for information 
from other states and from researchers in school imp.-ovement 
and effectiveness; and making presentations at national 
meetings such as AERA.* 

During the twelve months ending June 1983, the TAs spent 263 days on 
SITIP.** Officially each TA could spend 10% of his or her time on SITIP. In 
practice, investments (of work days) ranged from 2% (of the TA who handed ove 



* Time estimates do not include ADS contributions, which were high for this 

** The ADS spent time in addition to this, but' that is not included in this 
discussion. 
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AT responsibilitlen in December) to 35%, with one partner in each dyad 
investing 20% or more and the other partner investing 12% or less.* Almost 
twice as much time was invested by TV TAs (47%) as by AT TAs (25%), with ML 
(32%) and STL (27%) between those two. Allocation of time (as a percentage of 
263 days) is summarized for each of the ten-task areas in Table 7. It is 
interesting co note that investment was approximately double (in comparison to 
the previous year) for administration (10%), planning (8%), and dissemination 
(13%), and decreased considerably for site visits (15%). Also, in the 1982-83 
year TAs did distinguish their own knowledge building (10%) from materials 
development/identification (5%) and training activities (14%). Increase in 
time for administration and planning was influenced by increased TA responsi- 
bility for instructional Leadership Conferences, and (as local expansion 
occurred) the increase in complexity of coordination efforts. The increased 
time for dissemination related primarily to out-of-state presentations. The 
decrease in cime spent on site-visits did not mean that 'fewer visits were 
made, but rather that TAs became efficient in scheduling "back-to-back" v gits 
by geographical area. The combined time spant on knowledge building, 
materials, arid training (29% for 1^82-83, 22% for training the previous year) 
reflected TA's increased involvement , with SITIP implementation, their own 
needs for a sound knowledge base, arid a responsiveness to local needs and 
concerns. 

Impact 

Impact is discussed for^ the team and for each dyad. Relative success was 
influenced by many factors including: 



* These figures represent work days. Reve--^ TAs invested their own time x, 
add! t-o this. 
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• Regular" role the relationship of regular and SITIP tasks, 
including supervisor's attitude to SITIP, the balance of 
administrative vs. technical tasks, and comparative ease of 
integrating processes and knowledge bases 

• The models ~ developer access and support and complexity of 
implementation requirements - 

• Local needs ~ "fit" of model to local priorities, communica- 
tion among role grobps, stability of key staff, and attitudes 
toward SITIP and MSDE 

• TA motivation or perceived rewards, the "fit" of role set 
definition to local needs, expertise in application of planned 
change and in .the model(s) (or use of developer expertise). 

#0 ADS leadership, maintenance of clear and realistic expecta- 
tions, and coordination across organizational boundaries but 
with a tight focus on program goals. 

Accomplishments of the TA team included: providing leadership for a 

statewide school improvement program while at the same time encouraging local 

ownership; maintaining communication within MSDE and among LEAs; developing 

networks and teaching/ learning opportunities for local teams to share 

successes and build expertise; developing expertise among themselves and 

applying it not only in SITIP but also in other areas; and increasing 

awareness of effective SITIP practices to researchers and educators outside 

Maryland. The most apparent injpact made by the team related to the statewide 

training events (discussed earlier in this chapter). By involving others in 

planning, the team made an 'impact in that area (also discussed earlier). 

Impact relating specifically to assistance activities included: 

• increased trust and openness in /coimnunication between LEAs and 



• increased effort by some LEAs to carry out their plans 

• better linkage. or a clearer common knowledge among hierarchl- 
,.^cal levels within LEAs 



• Increased Involvement by central office staff In some LEAs 



• changes In planning, decision-making, and/or communication 
(e.g., more Involvement of teachers) In some LEAs. 

Impact for each model. Influenced by such factors as those presented earlier 
Included: 

• AT (trainer/coach) — better LEA/MSDE rapport. Increased 
expertise and confidence of local educators, modifications 
made to plans to facilitate continued and willing participa- 
tion, application of strategies to facilitate expansion, and 
application of knowledge and strategies to facilitate 
Implementation In three "new" LEAs. 

• ML (consultant/trainer) — better LEA/MSDE rapport, some 
Increased expertise of local educators, application of know- 
ledge and strategies tc facilitate Implementation In a "new" 
LEA; and a negative Impact In one LEA of confusion In cross- 
hierarchical communication and Inadequate strateglzlng to 
overcome problems. 

• STL (observer/networker) — better LEA/MSDE rapport, applica- 
tion of knowledge and strategies to facilitate Implementation 
in a "new" LEA, application of strategies to facilitate expan- 
sion, application of strategies (including accessing the 
developer) to^ maintain implementation and participate in net- 

/ working. / 
/ 

• TV (information linker/trainer) ~ better MSDE/LEA rapport, 
application of knowledge and strategies to facilitate imple- 
mentation in a "new" LEA (including accessing the developer), 
application of strategies to increase involvement of central 
office staff and to maintain or expand implementation, appli- 
cation of strategies to decrease teacher resistance and 
facilitate continued participation. 

/ *■ ■ . 

/The above examples of impact relate to TA actions. One other kind of Impact 
— local educators' disappointment — related to TA inaction. Specifically, 
some LEAs requested assistance, e.g., clarification of evaluation guidelines 
and received only part of what they needed. In other instances, LEAs wished 
that TAs had been more proactive or capable in offering help. In general, 
what was done by TAs was helpful to LEAs, but in some cases more quality and 
quantity was needed. While this was true to some extent for all models, the 
greatest need for better TA was indicated by ML sites. 




Summary and Concluslo r 

In the context of SITIP and ilso of other MSDE programs, the future of 
technical assistance was discussed by the TA team and by others during the 
Instructional Leadership Conferences. Also, scenarios were reviewed as to how 
local SITIP activities might evolve over the next few years. These Issues and 
Ideas" are summarized here, with local futures discussed first. 

Whlls some TAs advocate Institutionalization of the models at existing 
sites, others argue that each site should make a purposeful decision to termi- 
nate or Institutionalize based on the relative value (objective and subjec- 
tlve) of the model at that site. Several TAs also believe that all LEAs 
should understand all four models (their advantages and short-copings and what 
It takes to Implement them), should also have the opportunity to learn about 
others, and should encourage all teachers to use STL occasionally. There Is 
strong concensus that local application of strategies of planned change (e.g.. 
involvement of cross-hlerafchlcal teams. Interactive support Including 
training and follow-up assistance) are very important and should continue even 
if a model is terminated. 

Concerns relating to future local activities include: 

•. Status — in most LEAs SITIP has project status. Should it be 
incorporated into the regular instructional program? If so, 
would it survive? 

• Location — 16 of the 29 sites have a lighthouse school orien- " 
tation, and three of the capacity-building sites and two of 

the pilot-district sites are school-based. Yet in only one 
site is leadership formally based at a school. Under what 
circumstances is it more desirable for SITIP activities to be 
school-based? 

• Central office support ~ in 11 of the LEAs there was strong 
active involvement of central office staff. Support was 
responsive to school staff needs in nine LEAs, and in four 
cases central office- staff did little to help school staff. 



While school-based implementation may well continue with the 
principal's support, all sites want support from central 
of 'ce, ... ' for some models and implementation strategies that 
support is essential. ow can central office staff be 
encouraged to take greater responsibility for instructional 
improvement through SITIP? 

TAs continue to explore these concerns and, to date, have addressed them 

on a case by case basis. They have found that some LEAs are more willing than 

others to continue SITIP without MSDE support (funds and assistance), and 

individual TAs have varying opinions about the extent of future MSDE support 

and the conditions under which it should be provided. 



The SITIP TA role will continue through Jure 1984, with each person con- 
tributing 15% (about 35 days) of his or her time (instead of the 10% formerly 
allocated for the 1982-83 school year) . Two of the eight encumbents for the 
1983-84 year anticipate continued role conflict, and one of those plus two 
others anticipate work overload. All TAs see the 1983-84 year as crucial, and, 
in working with "veteran" LEAs, expect to be involved in "go — no go" deci- 
sion-making. In problem solving sessions TAs recommended for themselves to: 

• become well-informed generalists with a thorough knowledge of 
relevant research and how it should be applied* 

• continue existing/successful practices such as monthly TA 
meetings, model follow-ups, and site visits 

• find ways to increase local commitment and capacity and 
decrease dependency on MSDE 

• teach central office staff to manage -instructional improvement 

• help LEAs develop or establish a cadre of people and a system 
for them to provide leadership, training, and coaching (to 
avoid reliance on a single energizer and to facilitate 
expansion) 

• help create a positive climate, encouraging administrative and 
supervisory staff to acknowledge and publicize hard work and 
success 
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• enrich existing models, sharing expertise with local educators 

• conduct orientation sessions and weave SITIP references into 
presentations for other , programs for both MSDE and LEA staff. 

There was no consensus on funding.** TA recommendations included: (1) 
allocate $50,000 per year to each LEA implementing a cnplex model; (2) 
continue funding of matching grants until ^-EA is o assume full 

responsibility; (3) allocate funds, only f or •expansion to other schools; (4) 
offer school-based grants. There was agreement that LEAs should not continue 
SITIP simply because funds were available. Policy , decisions will be made by 
the ICC. ( 

Recognizing that SITIP may evolve into something, else, and/or that the TA 
role (and time allocations) may not be approved by the ICC after June 1984, 
the TA team expressed the hope that their experience would somehow be shared 
by other MSDE staff, and that the successes of the SITIP design would 
Influence future MSDE activities. 

Summary and Conclusions 
MSDE initiated a statewide instructional improvement program that offered 
LEAs choices of exemplary mo'dels. The state department established an organi- 
zational structure across divisions, using existing expertise and mechanisms 
to provide coordinated support and to facilitate communication. 



This expertise has been developed through reading, contact with visitors to 
Maryland (e.g., Rosenshine, Louis, Clements), contact with researchers and 
practitioners at outside conferences,, and contact with staff of Research 
tor Better Schools. TAs were particularly appreciative of RBS ^dsistance. 

** For the 1982-84 year each LEA was awarded up to $5,000 if it provided 
matching funds. MSDE will not subsidize local participation in state- 
sponsored training such as Instructional Leadership Conferences or follow- 
ups but each LEA involved In SITIP. is expected to send representatives to 
such events. 
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Planning activities invited participation across hierarchies and organi- 
zational units at the state and local levels. On-going communication about 
SITIP interacted with related activities in other program areas so that the 
"message'^'was clear, consistent, and widespread* The "message" was the 
research-based knowledge on classroom and school effectiveness, and planned 
change. 

Through various state-sponsored training activities, all members of the 
educational community in the state had the opportunity to learn about this 
knowledge base. LEA teams contributed to the training and learned from each 
othar and from "experts". Training activities were very well received and 
were followed up by assistance from MSDE staff. 

SITIP TAs worked as a team to contribute to planning, design training, 
and provide on-site assistance related specifically to the models. They also 
monitored plans, administered grants to local projects, and coordinated evalu- 
ation and dissemination activities so that data-based improvements could be 
made and successes could be widely spread. 

The obvious impact of MSDE initiatives and provision of assistance is the 
voluntary involvemerjt of all 24 LEAs, with all but one providing matching 
funds for continuation in the 1983-84 school year. The application of 
research on planned change facilitated the process (e.g., helped build commit- 
ment, maintained energy levels). The use of research-based models built 
credibility, and the provision of choice allowed LEAs to maintain their sense 
of autonomy. Other areas of impact arising from MSDE initiatives related to 
communication, coordination, widespread understanding of a common knowledge 
base, and a high sense of professional achievement on the part of those 
involved in SITIP. 

SO 



Maryland's efforts are acknowledged as successful In many ways by other 
states and by researchers in school Improvement. For instance, when Karen 
Louis met with the TA team she said she had read a great deal about Maryland' 
school improvement efforts an^ saw the state as being one of about half a 
dozen state education agencies systematically investing in helping many LEAs 
and schools. Maryland features that impressed Dr. Louis include: the R&D 
knowledge base is clear; the role of technical assistants is research based; 
MSDE is providing quality information/models with sound research bases; there 
is provision of training and funds for local implementation with relevant 
follow-up; LEAs have choices and are building their capacity; and there is 
attention to monitoring the implementation of state-funded projects. 

"Outside" statements such as these, LEA reactions, and comparison to the 
literature on school improvement and planned change, indicate. that Maryland's 
state initiatives and provision of technical assistance are exemplary. 
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V. LOCAL IMPLEMENTATION AND IMPACT 

This chapter describes local implementation and impact of the SITIP 
models for the 1982-.83 school year. The overall question addressed was: 

•CO.. 

• What was the nature and extent of local implementation and impact 
for the second year of the project? 



Tjie basic criterion for success was implementation of local plans:. 

• Did the school district carry out the activities/objectives planned 
by local staff? 



Additional questions addressed were derivTa primarily from the literature on 
planned change: ' 

• What were the scope and intensity of implementation and the types of 
local strategies used, and how did these factors influence any 
changes that were made? 

• What were the patterns of local participation in planning and train- 
ing events for each role group? 

• What were the roles and responsibilities of local participants? 

• What proportions of the school year and of class time were spent on 
the models? ' 



• What was the impact on schools and school systems, on educators, on 
students^ and on instructioia in general? 

• What needs and concerns were expressed by participants that might be - 
addressed in the third year of implementation? ^ . 

Finally, the answers to these questions were synthesized to determine: 

^ • How did the various factors interact to influence project success? 

In the following pages, local participation in state-initiated planning 

and training activities is summarized, and each model is discussed in turn in 

terms of LEA participation in planning, scope and intensity, time ..pent on the 

model, roles and responsibilities, impact, and participant concerns. LEA cese 

reports and brief summaries are presented for eacl:. model, and a final summary 

discusses conclusions and implications across models. 
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6 General Backj^round \ 

This section summarizes the planning and traini^^ initiatives of MSDE 
for local schooV systems that were designed to facilitate local implementa- 
tion. 

Planniufz ; , 

Local school systems interested in participating in the SITIP program 
were asked by MSDE to develop plans and attend planning sessions. Specif i- 
cally, L^s were asked to: » 

• develop proposals identifying the SITIP model(s) to^be implemented 
and describing how and -why implementation was to be done (winter 
19ol) o J 

o attend a planning session fo^ clarification of models and assessment 
of training needs (spring 1981) f 

• !n5^?^ 1 P-'inning session to review and revise implementation plans 
and trainxny needs (fall 1981) 

• develop standardized summaries of final plans using the Promising 
?QS?^«ir^ -ru^^''''^"^ Submittal (PEPPS) form (winter 

, 1981-82) This single page form called for eight categories of 

information: purpose, target population, description, special 
considerations, staff development, cost, results, and services 
available. o 

All three role groups (teachers, school administrators, and central 
office staff) were involved to some extent in planning In all of the LEAs\ 
across all the of models. 

Sustained involvement was important to maintain continuity. 
Eight LEAS maintained involvement of a central office person, ten 
LEAS maintained involvement of a school administrator, arid eight 
maintained involvement of a teacher. For six sites n6 one sus- 
tained participation in all six activities. At three sites minor 
problems occurred as a result of lack of sustained involvement : 
1) a lack of awareness of other LEA activities required greatc. 
dependency on within-LEA resources (knowledge , Networking , 
-support). In one case, and 2) commitment and energy to implement 
?982r ^ ^ relatively low in two sites. (Roberts et al.. 



For the second year of the project (1982-83), five "new" LEAs submittt^d 
PEPPS forms. MSDE staff provided planning assistance to each of these new 
LEAs. Continuing LEAs updated their original PEPPS forms if changes had been 
made. Although the major purpose of SITIP in several LEAs was to impact 
teacher behavior and instructional improvement to varying degrees through 
staff development, the majority of the districts Were primarily interested in 
Increasing student achievement. „ 

The districts used four strategies to achieve their objectives: 

• the district-wide strategy involved all schools at a given level 
(elementary, junior/middle." high school) and demanded the greatest 
level of effort among the four strategies, high enthusiasm from 
central office staff, and a perceived need by all role groups. 

• the £ilot-district, strategy involved one or a few schools in the 
first year with commitment from central office to become actively 
Involved in dissemination/implementation to many more schools in 
subsequent years. 

• capacity buildinp was essentially a staff development strategy which 
encouraged voluntary implementation by teachers following training ■ 
conducted by those first involved with SITIP. 

• the lighthouse school strategy focused on implementation of a model 
in a single school. Success was broadcast informally. No formal 
commitment was made by central office staff to actively encourage or 
train other schools to adopt the model of the lighthouse school. 

^ By September 1982. four models had been adopted: Active Teaching (AT) by 

seven LEAs. Mastery Learning (ML) by seven LEAs. Student Team Learning (STL) 

by nine LEAs. and Teaching Variables (TV) by six LEAs. 
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Training* 

The SHIP program Included three kinds of training events organized by 

MSDE: 

• Awareness Conferences for each of the four models were conducted 
between December 1980 and February 1981. 

• Summer Institutes , for each model were conducted In June and July 1981 
for participants who had decided to {Implement the specific model, fiv^- 
July 1983, a summer Institute was conducted for both new SITIP 
participants and for educators who had been previously Involved. New 
participants attended model training sessions while "veteran" educa- 
tors learned about the management of change. 

. • Model-specific Follow-up Sessions were conducted between December 1981 

^ and May 1983 for those Implementing the model. 

In keeping with recommendations. In the literature on planned change, MSDE 
encouraged participation of cross-hierarchical teams from each LEA, and LEA 

■ • . i - ^ ^ ■ 

superintendents agreed to try to meet those requirements by sending teachers, 
principals, and central of flee staBi- to- the training-events. Overall attend- 
ance In terms of numbers, roles, and sustained participation across several 
training events was good. The training activities, especially the summer 
Institutes and follow-ups, were attended most frequently by teachers. 

In addition to those three types of training events planned arid conducted 
by MSDE as part of the SITIP design, other related events attended by local, 
educators were Instructional leadership conferences and Instructional Improve- 
ment presentations. 

Two Instructional leadership conferences were held for state and local ' 
staff. Local superintendents were askeci to Include SITIP participants on 



c t; 

* This section summarizes training conducted by MSDE statewide. Detailed 
descriptions are presented in the previous chapter, LEA-specific training 
is not discussed in detail here. The LEAs used various methods of turnkey 
training to inservice their staff . In some counties teachers did the 
training, other counties asked the develop *;rs or MSDE to train their staff, 
while several counties used central office staff or principals as trainers. 
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their team as a reward for their„ef forts . At the first conference in April 
1982. attended by approximately 300 participants, Barak Rosenshine and Robert 
Bush discussed. research on teacher and school effectiveness and effective 
staff development. 

The second conference, in May 1983, was attended by approximately 420 
educators who heard Karen Louis and Madeline Hunter discuss the research on 
planned change and teacher effectiveness. LEA teams? involved in SITIP ' 
reported on their districts' projects during small group sessions. LEA 
superintendents were present and introduced their district's LEA team. 

The need for greater central office involvement in SITIP indicated in 
the 1982 SITIP report, and the general interest in research on instructional 
improvement and planned change expressed by state and local superintendents, 
led to training events conducted by RBS for MSDE and for LEA assistant 
superintendents and LEA-based staff with responsibilities in instructional 
improvement. All LEAs participated in at least one such event; three LEAs 
invited RBS to conduct on-site workshops. 

In all of these additional training events, references were made to SITIP 
by the presenters, and the^f elationship between SITIP models and strategies 
and the. programs conducted in other states was specified, 

^ Active Teaj^hing (AT) 

- As stated in Chapter II, Active Teaching (AT) is a system of direct ' 
instruction. Out of the 19 LEAs involved in SITIP during 1981-82, five LEAs 
(Cecil, Garrett, Harford, Montgomery, and St. Mary's) implemented Al. In 
1982-83, two additional counties (Caroline and Wicomico) became involved in 
AT. This section describes the implementation of AT, including discussions on 
planning; scope and intensity of implementation; time spent on. implementing 
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AT; roles and, responsibilities of AT implement ers; AT impact on school sys- 
tems, individual schools, educators, and students; and participant concerns. 
Planning . ^ 

The extent of involy^ement of AT implementers in MSDE-organized planning 

activities during the 1981-82 school year is summarized below: 

With the expection of one county, all LEAs attempted to involve 
all three role groups (and sustain that involvement) in planning 
activities initiated by MSDE. However, teachers were l^ast 
involved in planning (particularly in Cecil and Montgomery 
Counties), and school administrators in Garrett County were not 
sufficiently involved in planning. ... (Roberts et al., 1982) 

For the 1982-83 school year, MSDE did not organize any group planning 
activities but provided individual assistance in preparing PEPPS proposals to 
the "new" LEAs. None of the veteran AT LEAs changed their original plans. 

An analysis of local plans for the 1982-83 school year identified LEA 
objectives and the status of each at the beginning of September 1982.* 
Table 8 presents the objectives. In each case, tdie percent of LEAs that 
"hoped for," "partly achieved," or "already achieved" each objective is 
indicated. As can be seen, there were nine objectives identified. All were ' 
addressed to some extent by the participating LEAs. Improving student 
achievement in basic skills and teachers' classroom competence were the two 
objectives addressed by the 'largest number of counties. Improving student 
achievement ia basic skills was the only objective that i/as "achieved" by any 
of the counties as of September 1982. Ensuring a match between instruction, 
curriculum, and tests was least addressed because it^is not a component of the 
AT model. The remaining^ objectives were either "hoped for" or "partly 
achieved" by the coi^nties addressing those objectives. 

* New LEAs were not required to submit information on status of objectives in 
September 1982. However, Caroline County did submit objectives which are 
included in Table 8. 

" .78 • ■ 8 7 



Table 8 



Status of /Local Objectives, 1982-83: Active Teaching 



/ 



Local Objectives 



1. Improve student achievement 
(basic skills) . 

2. 'Improve student achievement 

(other subjects). 



3. Inform local educators about model. 

^. Train educators to use model. 
c 0 

0. Improve teachers' classroom 
competence. 

6., Ensure match of instruction, 
curriculum, and test(s). 

7. Help teachers become better 
organized. 

8. Improve time-on-task. 

9. Improve students' involvement in 
learning (motivation). 



10. Other (L corporate Hunter's 
learning theory) 



Status 



N 



4! 
6 



5 

4 



.Pre-(Sept. 1982) f ] 



^Percent o 
1* I 2* 



f LEAs 



50 

50 

50 
50 
50 

0 

25 

60 
50 



33 

50 

50 
50 
50 

100 

75 

40 
50 



3* 



17 



0 
0 
0 

^ 0 



0 
0 



N 



6 
5 
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*1 . 

2 = 

3 = 



Hoped 'for 
Partly achieved 
Achieved 



Post-(June 1983)' 



Percent of LEAs 
T* I 2* I ' 3* 



33 



\ 

67 



0 
0 
0 



Me. Total number of LEAs equals 7. 
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50 
33 

50 

■80 
71- 

0 

67 

67 
83 



100 



17 
0 

50 
20 
29 

100" 

33 

.33^ 
17 



Scope and Intensity of Implementation 

In September 1982, seven counties were involved in AT. Caroline and 
Wicomico were just beginning their involvement. Cecil. Garrett. Harford. 
Montgomery and St. Mary's counties were in their second year of implementa- 
tion. As can be seen in Table 9, the scope and intensity of implementation 
varied among the five "veteran" counties in June 1982 from five teachers and 
180 students in one elementary school in one county, to 434 teachers and 
il,9I0 students in 26 elementary schools in another county. Across the five 
^ LEAS, approximately 33 schools and 473 teachers in a variety of subject areas 
were involved in AT. 

Table 10 presents the scope and intensity of AT implementation in June 
1983. Across the seven LEAs, all four implementation strategies were being 
used (lighthouse school=3; pilot district=l; district-wide=2; capacity 
buildin£=l),. Approximately 581 teachers in 73 elementary, and secondary - 
schools were implementing AT. All counties used AT in mathematics, and 
several counties tried AT in other subject areas. 

The percentage of schools in each county implementing AT as of June 
1983 ranged from .6% in Montgomery County to 79% in Harford County. Across 
the entire state.' 6% of the schools were involved in AT at the end of the 
1982-83 school year. 

„Some major changes occurred between June 1982 and June 1983 including 
the two new LEAs Caroline decided to use a lightnouse school approach in two 
elementary schotrls with five teachers in mathematics; Wicomico used a ' 
district-wide strategy to implement AT in 12 elementary schools with 43 
teachers in mathematics. In the five "veteran" LEAs, the .cope and intensify 
of implementation. increased somewhat between June 1982 and June 1983. but none 
of the five districts changed its implementation strategy; Four LEAs ' . 
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Table' 9 

Scope and Intensity. June 1982: Active Teaching 




^HMect^: R/u.Reading. language art 
M«Mathematics 
Sc»Science 
SS»Social studies 
O^Other 

IZE£! E«=Eleraentary school 
J/M«Junior high/middle 
^ H=High school . 

0=Other 

90 



Strata^ : LS=Lighthouse school 
PD=Pilot district ' 
DW=District wide 
CB=Capacity building 



91 



ERIC 



0 
3 

I 

1 



LEA 



Garrett 



Harford 



Montgomery 



St, Mary' 



Wicomico 



•Table 10 

Scope and Intensity, June 1983: Active Teaching. 




LS 



DW 



E, J/M 



LS 



^43 



.19,177 



CB 



BW 



^Includes some duplicates 



12 



E, J/M, H 



27 



1,195* 



1,100 
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, »!CU]^ X/Meading, language arts 
; H'Matheniatics 
Sc»Science 

SS«Social studies 
0«Other 



Subject Areas 




Strategy 



I of 
Schools 



f of 
Teachers 



I of 
Students 



R/LA, M, Sc, 0 



M 



R/U, H 



R/LA, M, SS, 0 



M 



^^acegy = LS=Lighthouse school 
PHilot district • 
, I)W=District wide 
CB=Capaclty building 
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^E'Elementary school 
J/H'=Junior high/middle 

H='Hlgh schoor 
. O^-'Other 



increased the number of involved schools . two included additional grade 
levels, all five added teachers, and four had more students involved. Subject 
areas remained fairly constant. 

Scope and intensity also pertains to fidelity-the extent to which 
teachers implement thfi model as designed. AT. as designed, requires the 
implementation of six components: pre-lesson development, lesson develop- 
ment, controlled/guided practice, independent practice, homework assign- 
ments, and reviews. Of 57 teachers responding to the General Survey.* 72% 
carried out all six components. No component was addressed by less than 87% 
of the teachers. Components most consistently addressed were: lesson 
development (by 93% of the teachers), and independent practice and homework 
assignments (each by 91% of the teachers) . ^ Teachers ' indicated that the most 
important components (in terms of instructional value) were pre-lesson 
development and controlled practice. Reviews in various forms were also 
considered important. The greatest fidelity was maintained in Caroline and 
Wicomico counties (both "new" and therefore strongly encouraged not to 
adapt). Greatest adaption occurred in St. Mary's (where the greatest range of 
subject areas were included) . In general, fidelity was high, with adaption 
most likely to occur in subjects less "structured" than mathematics and/or In 
secondary schools. (AT was designed primarily for elementary mathematics.) 
Time Spent on the Model* * ."^ 

This section discusses time spent on AT during the 1982-83 school year. 



* No data were available for Harford County. 

** This information is based primarily ; on- the responses made by a sample of 
. implementers who completed the General Survey. ^ 
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Time across the school year is discussed first, followed by a discussion of 
the time spent by teachers, by school administrators, and by central office 
staff. 

Across the school year. During the 1981-82 school year, AT was used by 
each teacher for an average of just over three months. Some teachers from all 
of the counties began using AT at the beginning of the year, but in Harford 
most. teachers did not begin implementing until March 1982. The majority of 
teachers continued implementing AT in their classrooms through June 1982. 

During the 1982-83^chool year, implemeriters across the seven counties 
were involved in SITIP for an average of eight months, with no one involved 
for less than seven months. St. Mary's had the lowest and Caroline had the 
highest average number of months involved. 

In the classroom. During the first year of implementation (1981-82), all 
AT teachers used the model in their classrooms between 50% and 80% of the time 
allocated for the selected subject. 

Teachers implementing AT in mathematics used the instructional / 
process during at least 80% of the allocated mathematics time. 
In other subject areas, teachers used AT for about 50% of the 
time allocated for that subject. This difference in the percent- 
age of classroom time spent using: AT was due , to the fact that it 
is designed for structured learning activities, and is not per- 
ceived by teachers to be appropriate for more creative activities 
such as composition writing (Roberts et al., 1982). 

In 1982-83, the teachers responding to the General Survey (N=63) indica- 
ted that they spent an average of 39% of their school week on AT-related 
activities. The primary activity for the majority of teachers was classroom 
implementation. However, some teachers also sjient time on planning and/or on 
training. Elementary teachers using AT in one or two subject areas spent an 
average of 21% of their school week implementing AT. Secondary teachers using 
AT in their 'specific subject areas spent a larger percentage (51%) of their 



school week Involved in AT. In general, local educators indicated that AT did 
not take any more or any less time than similar innovations in terms of 
teachers' preparation of students (e.g., grouping, pre-testing) , or in terms 
of curriculum coverage. 

School and central office administrators .* Twenty-six schodl adminis- 
trators and central office staff across the seven LEAs spent an average of 10 
days on AT. The average number of days ranged from 23 in Harford to three in 
Wicomico. In general, central office, staff spent more time on SITIP (13 days)- 
than did school administrators (7 days). / 

Thirty-seven central office staff and /school administrators reported 
spending about the same amount of time and /energy on SITIP as^they had on 
similar previous projects. However, in Montgomery County, the central 
office person and school administrator answering the survey reported that 
"substantially moie" time and energy had been spent ,pn SITIP, while the 
educat?ors from St. Mary's and Wicomico counties reported their expenditure of 
time and energy to be "slightly less." . 

Roles and Responsibilities . ^ \ 

- The SITIP design encouragio involvement of cross-hierarchical teai5is, 
Including: 1) central pff ice staff, e.g. , supervisors in instruction or ^ 
coordinators of staff development; 2) school administrators, e.g., principals, 
vice principals, or department heads; and 3) classroom teachers. This section 
describes the people involved, what they did, and^' their relationship to aach 
other from three perspectives: usual assigned roles, activities undertaken 
and levels of effort and interactive support. 



* Np data were available from schpol administrators in' Harford and Montgomery 
counties or from central office staff in Wicomico County. ■ 



Usual roles . Teachers, school-based administrators, and central office 
staff were all involved in AT. Of the 18 central office staff responding to ' 
the 1983 General Survey, one was in staff development, nine were in instruc- 
tion, and four were in "other" areas such as curriculum development. Four had 
multiple responsibilities. Of the 28 school administrators responding to 
the survey, 27 were principals (18 elementary. 3 junior high/middle. 2 high 
school, and 4 no grade level indication) and one was a high, school vice- 
principal. While both elementary and secondary teachers were almost equally 
represented as survey respondents, most implementation was carried out by 
elementary teachers: about twice as many elementary vs. secondary students 
were Impacted by AT. 

Activities and levels of effort . On the General Survey, six acti/ity 
areas were identified and central office staff and school administrators were 
asked to indicate leveL of effort (time and energy) spent on each (with 
responses ranging from 0 "none" to 5 "a great deal"). The areas of acti,.ity 
were: 1) administration (including planning and budget); 2) development of 
materials; 3) designing and/or conducting inservices; 4) supporting school 
implementation (e.g.. problem-solving, supplying materials, etc.); 5) 
dissemination; and 6) evaluation. (Mean ratings are presented in Table 11), 

The level of ,ef fort spent by central office staff and school adminis- 
trators on each activity area during the first year of implementation 
(1981-82) is summarized below: 

.nhni? L f .T °" ^<^'^i^i«'^-^tion. inservice. and support, but 

ma^erl.f ^ 'r^' """^ '^^"'^"1 'taff on 

materials development, dissemination, and evaluation. Least 

i^dJ^ldl^^^ °" materials development. An examination of 

Individual responses indicates that within each county office 
invo?ve5%r'^r'r °^ Montgomery) at least one individual was 
involved in all- six areas of activity. Most central office staff 
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Table 11 , 

Level of Effort: Active Teaching, 1982-83 




87 



33 
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effort was spent on Inservlce and support, followed by adminis- 
tration. If other central office staff were involved, they 
helped this individual, most often in inservice and support, but 

also in evaluation, dissemination, and to some extent 

administration. Although most school administrators distributed 
their effortsin similar ways (focusing most on support, 
inservice, and dissemination within their own schools), three 
broke this pattern, indicating that they did very little in those - 
three areas, two saying they did even less in the other three 
areas, and one spending more effort on materials, evaluation, and 
administration, (Roberts et al. , 1982) 

As can be seen In Table 11, during 1982-83, central office staff and school 
administrators combined spent the least amount of time on materials develop- 
ment (2.05), and the most amount of time on supporting school implementation 
(3.17). Central office staff reported spending more time on all areas than 
did school administrators. 

Individual county responses indicated that there was some level of effort 
spent on each activity across all of the LEAs. In addition t<) the iiategories 
supporting school implementation and designing/conducting inservice, evalua- 
tion was ranked high in one county (Caroline) .administration in three 
counties (Cecil, Garrett, Montgomery), and disse^ation in one county (St. 
Mary's). 

Interact ive support . Teachers implementing AT could re^ve training/ 
information from four sources: developers, MSDE, central office s^ff, and 
school-based staff (school administrators and teachers). The largest^^cent- 
age of teachers responding to the survey (N=59)* received information and 
training from school administrators and teachers (46%), and from MSDE and 
central office staff (44% each). Only 15% of 'the teachers received 
information and training from the developer and these teachers were 
'Veterans"! who attended the Awareness Conferences arid Summer Institute during 
the first year of the project. 



A_liQ..data/were available f or^ Harford County. 
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Within the individual counties, the majority of teachers in Caroline 
(67%) and Garrett (89%) ^rece.ived information/training from MSDE. In Cecil 
County, all teachers received training from central office staff. The 
majority of Montgomery (100%) and St. Mary's (88%) teachers received theiv 
training from both school administrators and fellow teachers. In Wicomico 
County, almost all teachers received their training from both MSDE and central 
office staff. 

Survey respondents were asked to rate the support received from 
teachers, principals, central office staff, MSDE. and developers ' (from 1.00 = 
very poor, to 5.00 = excellent) . Ratings of interactive support from the 1982 
survey are summarized below: 

... for AT. central office staff were generally more positive 
in their assessment, rating all but the developers as good to 
excellent. Teachers, most of whom did not interact with MSDE 
staff or developers, were.,' in general, less positive. However 
overall mean ratings indickte that each role group was perceived 
positively by peers and other role groups in terms of providing 
\ information, help, and gen'eral support. (Roberts et al.. 1982) 

As shown, in Table 12. resi)'ondents of the 1983 survey* rated the inter- 

! 

active support received from ail five role groups as 3.16 (average) or above 
indicating that each group was perceived positively by other educators 
involved in AT in terms of providing information, help, and general support. . 
Developers received' the lowest total rating (3.24) because very few of the 
respondents interacted directly with the AT developers. School administrators 
received the highest total rating (3.83). Central office staff were generally 
more positive in their assessment, rating all but the developers as good to 



No data were available from central office staff in Wicomico County. 
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excellent. Teache:rs were, in general, least positive in thair assessments 
except for their ratings of support from MSDE and developers, which were 
slightly highrr than the ratings given by the school administrators • 

The mean ratings given to the five role groups by the survey respon- 
dents in each of the individual counties were above average except for the 
following cases: 

• teachers from Harford County rated support from MSDE as below average 
(2.00) because most received direct assistance from central office 
staff (who "turnkeyed" help from MSDE) 

• the school administrator from Montgomery and teachers from St. Mary's 
rated central office support as below average (2.00 and 2.57, 
respectively) . 

Impact 

This section discusses AT impact in the area of training and on school* 
systems, individual schools, central office staff, school administrators, 
teachers, and students. 

Training . MSDE TAs held two follow-up training . sessions for those 
counties implementing AT. The first session was a combined follow-up^ held in 
the fall of 1982 at MSDE with participants implementing STL and TV. ' Approxi- 
mately 16 AT participants were present. During this joint follow-up, the 
1982-83 evaluation design was reviewed by RBS and participants met .in small 

wdel-specific groups to "review plans an^'lio^ sKare^^Tieetls^^ cdricerns . ^ ' The ' ^" 

second AT follow-up training session was a two-day retreat held in the spring 
of 1983 at Great Oaks Landing, Maryland and was attended by approximately 33 
LEA participants. The session consisted of LEA project updates and a presen- 
tation by Barbara Clients from the Texas Research and Development Center ^or 
Teacher Education on the research on classroom management. 
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AT participant evaluations of l>oth sessions (e.g., clarity, relevancy > 
and accomplishment of objectives; support from MSDE) were positive, the mean 



5.00 (most positive). The majority of the AT participants most enjoyed the 
small group discussion activities. The needs expressed for future TA activi- 
ties were varied, including requests for help in evaluation, dissemination, 
planning, and training. 

As indicated previously, teachers responding to the General Survey 
indicated that they received information and training from a variety of 
sources > including school administrators, fellow -teachers, central office 
staff, and state TAs, The majority of the teachers in the two "new'* counties 
received training from MSDE (Caroline and Wicomico) ^and from central office 
staff (Wicomico) . Teachers from district-wide and pilot district school 
systems (Cecil, Wicomico, Harford) received their training from central office 
and, to some extent, from state staff. School systems with lighthouse schools 
or teacher-directed programs (e.g., Montgomery,' St . Mary's) used school-based 



personnel (principals, teachers) for training, with the exception of Garrett 
which used state staff. 

The majority of teachers indicated that they understood the model (72%) 



ment with AT (66%). Only 13% ;;Lndicated that their teaching ability had not 
changed. In general, this pattern of results was consistent across the seven 
counties with the i'^xception of- Montgomery County where 50% of the teachers 
felt that their teaching ability had not changed. Less than 15% of fi^c'. 
teachers in each county felt that they needed to learn more about AT except in 



responses ranging from 3.39 to 4.57 on a scale from 1.00 (least positive) to 



and that their teaching ability had improved as' a result "of their ihvblve^^^ 



Cecil (17%), Garrett (22%) and St. Mary's (19%) counties. 
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As mentioned previously, accurate implementation of the AT model ^ 
involved the use of six components. Seventy-two percent of the survey 
respondents indicated that they carried out all six components and no 
component was addressed by less than 87% of the teacher respondents. This 
faithful use of the model can be related to the effectiveness of the 
training received by the implementers, the majority of whom indicated that 
they understood the model. 

School system . The impact of an innovation on a schoot system involves 
changes" in practice or policv that affect or could, affect more than a single 
school or single grovjp of educators. Systemic impact on implementing school 
systems included: 

• policy decisions such as using AT in certain subjects/grades 
district-wide (3 counties) and regrouping to obtain homogeneity 
(1 county) 

• changes in areas of emphasis such as on staff development (1 county) 

• application of research on school improvement and effective teaching 
(1 county) 

• improved communication, sharing, and cooperation among educators 
across the district (2 counties). 

These outcomes were influenced by various factors including administra- 
tors* perceptions that teachers accepted AT and students benefitted, and that 
' AT a^id^'tlie" SITIP pFoceHures w^^ supervise,. and.,ji,dnilnister 

(e.g., financing arrangements). Finally, since the the state requires 
students to pass a competency test in mathematics in order to graduate, some 
counties hoped that systematic use of AT would improve achievement in that 
subject. 

Central office staff . AT had an impact on central office staff in.a 
variety of ways. Central office staff felt tHat -involvement in SITIP allowed 
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them to gain experience in the^use of a new instructional technique (2 
counties), made them better organiEed (2 counties) .= gave them a means of 
helping ineffective -teachers (1 county), made them aware of how students use 
time (1 county), allowed them to become more involved with students (1 
county), gave them a respect for the SITIP process (1 county), and enabled 
them to improve instruction with the support of MSD? (1 coun^-) . 

These results reflect on the individual supervisors' attitudes and 
behavior rather than on policy or practice decisions of the system. In ■ 
general, such results are most apparent when a central office supervisor is 
directly involved in AT, advocating it as a technique with many of the 
teachers supervised. 

Schools. The impact of an innovation on a ^single school involves only 
those educators within that school. AT impac. on single schools included: 
greater continuity/consistency within those subject areas and teachers using 
AT (4 counties); increased interest in the selected subject area(s) in which 
AT was being implemented (2 counties); teacher enthusiasm and sharing (3 
counties); structured daily program/ improved management system (2 counties); 
closer monitoring/supervision of lessons by principals and supervisors (2 
counties); increased awareness of school needs (1 county); better definition 
of student and teacher roles (1 county); adoption of a uniform homework policy 
la^county) ; and grass-roots expansion-into^^ther . sub j ect " areas (1 - county) . 
Educators from one county felt that AT was especially useful in slower, low 
ability classes. 

These results were influenced primarily by the reactions of sch- ^l-based 
staff to AT, particularly when a group of teachers worked as a team and/or the 
principal was strongly supportive of the program. 
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school administrators . School administrators felt that their involvement 
iri AT enabled them to learn about a new teaching technique (3 counties) , to 
become better organized (2 counties), to experience the satisfaction of being 
part of a, successful project (2 counties), to become aware of an effective 
method of observation/supervision (3 counties)', to strengthen their conviction 
that traditional instruction works (2 counties), and to share ideas with 
teachers (1 county). 

These results reflect strong attitudes of instructional leadership by 
school administrators providing support to their teachers. 

Class rooms and t eachers. AT impact on teachers fell into 13 categories 
under the three general areas of: (1) increased knowledge. (2) improved 
skills, and (3) strengthened attitudes/perceptions, (See Table 13.) In addi- 
tion.- survey respondents assessed relative instructional value and impact on 
teachers in six areas on a five-point Likert scale. (See Table 14.)1 

Teachers, across the largest number of counties' reported four main teacher 
Impact categories: (1) increased knowledge of the components of effective 
teaching; and iir.proved skills in (2) .rgauization. structure, planning, and 
pacing. (3) the effective use of time, and (4) in assessing and addressing 
student needs. Sc.hool administrators across the largest number of counties 
reported two categories of impact on teachers: (1) improved skills in a new 
teacbins-technique. and (2) skill in organization, structure, planning, and 
P^'^^"^- Central office staff found that teachers improved skills in 
organization, structure, planning, and pacing^ 

As can be seen in Table 14. survey respondents in general indicated that 
AT was a worthwhile/workable model, with mean responses ranging from 4. '29 to 

4.47 (on a scale from 1.00 least Do^l^lvp ^n q nn j j ^ 

ieast pooiciye Co :).00 most positive). Teachers 
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Table 13 



Impact on Teachers as Reported by , 
Each Role Group: Active Teaching 1982-83 



Impact on Teachers 



Role Groups , 
(Reported in No. of LEAs 
N=7) 



CO 



As a result of AT teachers have: 
Increased knowled ge 

-of the components of effective teaching. 
Improved skills 

-in a new teaching technique. 

-in organization/structure/ 
planning/pacing. 

-in the effective use of time. ° , ^ „ 

rin the components of effective teaching 
(e.g., review, lesson development, 
controlled practice, homework). 

-in assessing and .addressing student needs 

-in instruction. 

Strengthened at titudes/perceptions 

-that traditional teaching techniques work, 
-that teachers must teach every day. 
-that the larger group must be emphasized.' 
-of teachers'' confidence and self image, 
-of the value of specific components of 

effective teaching, 
-about teaching (e.g., involvement).- 



SA 



5 
3 



0 
1 
3 



0 
1 
0 
1 

0 
1 



5 
4 



2 
1 
3 



2 
1 
1 

1., 

0 
3 



3 
6 
2 



0 
1 
3 
3 



" 1 



CO = Centrgl Office; SA = School Administrators; T = Teachers 
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Instructional Impact as Perceived by. 
Survey Respondents: Active Teaching, 1982-1983 



Impact on Instruction 



Instructional Valut 

WoiKs in classroom. 

Is worth the work it takes. 

Is a worthwhile teaching approach. 

Impact on Teachers .. 

Teachers enjoy it. 

Teachers have increased knowledge. 

Teachers have increased skills. 

-Impact on Students 

Students enjoy it. 
Students are less disruptive. 
"Students' achievement has increased. 
Students are learning more. 
Students' general behavior is better. 

Time 

Teachers spend more time preparing students, 
leachcrs cover curriculum in lesi time. 



Role Groups 



CO 
N=18 



4.61 
4.67 
4.6 7 



4.22 
4.50 
4.44 



3.94 
4.00 
3.61 
3.78 
3.7 8 



3.00 

3.50 



SA 
N=28 



4.57 

4.50. 

4.54 



4.07 
4.11 
4.18 



4.04 
3.90 
3.54 
3.71 
3.81 



3.18 
3.3Z 



T 

N=76 



4.41 
4.12 
4 .26 



3.95 
3.97 
3.91 



3.82 
3.84 
3.60 
3.54 
3.69 



3.08 
2.96 



Total 
N=122 



4.47 
4.29 
4.38 



4.02 
4.08 
4.05 



3.88 
3.88 
3.59 
3.61 
3.73 



3.09 
3.13 



Mean ratings range from 1.00 (strongly disagree-* t-n s nn / . 
CO = Central Office- SA = School AH^TI/: ^ (strongly agree) 

.■■j-xLc, OA bcnooi Administrators; T = Teachers 
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were consistently lower in their ratings of instructional value than were 
school administrators or central office staff. Central office staff gave the 
highest ratings. 

In summary, participants indicated that AT works in the classroom and has 
had an impact on teachers, especially in the areas of increase'd knowledge of 
what constitutes effective teaching and improved skills in the organization 
of instruction. 

Students. Over 24,000 students received instruction based on the AT 
model, and just over one third were in secondary schools. Impact of AT on. 
students fell into 15 categories under the three general areas of improved 
attitudes or awareness, increased achievement, and benefits from better 
instruction. (See Table 15.) In addition, survey respondents assessed 
relative impact on students in five areas on a five-point Likert scale. (See. 
Table 14.) Also, LEAs were asked to submit data summaries of AT impact on 
student achievement and attitudes. 

All three general areas of student impact (i.e., improved attitudes or 
awareness, increased achievement, and benefits from better instruction) were 
reported by educators, from about the samd number of counties. 

a'^^oss the largest number of LEAs reported two main student 
impact categories: (1) increased achievement in mastery/retention of facts 
and skills, and (2) benefits from better instruction which provides a clear 
understanding of teacher expectations. Improved attitudes about lear'i^g/ ~ 
school, increased achievement in test scores, and benefits from better 
instruction which results in better usage of time were the three sf-lent 
impact categories reported by school administrators across the largest number 
of counties. Improved attitudes about learning/school and benefits from 
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Table 15 



Impact on Students as Reported by 
Each Role Group: Active Teaching 1982-83 



Impact on Students 

\ 



As a result of AT students have: 
Improved attitudes or awareness 

• -about their learning ability 

(e.g., increased confidence), 
-about their learning responsibilities 

(e.g., accountability), 
-about learning/school (e.g., increased 

interest, involvement, enthusiasm, 

motivation) . 

Increased achievement 

-iji mastery/retention of facts 

and skills. < 
-in problem-solving abilities, 
-in grades, 
-in test scores. 

Benefitted from better instruction 
which p ro vides 

-a structured, consistent format, 
-a clear understanding of teacher expec- 
tations, 
-effective learning activities 

(e.g., review, practice, homework), 
-more individualized attention, 
-opportune -y for independent work, 
'-better us^ of time/more material covered', 
-large group instruction, 
-special benefits for slower students. 



Role Groups 
Reported in No. of LEAs ; 
N=7 



CO 



1 
0 

0 

2 



0 
0 
0 
0 
0 
0 



SA 



0 
1 



1 
0 

1 

3 



0 
0 
1 
3 
0 
0 



4 
2 
1 
3 



3 
1 
0 
2 
1 
1 



CO - Central Office; SA = School Administrators; T = Teachers 
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better instruction which provides a structured, consistent l^^o^TTo^'^^;^ 
the student impact categories mentioned by central office staff across the 
largest number of counties. All three role groups reported improved student 
attitudes or awareness about learning ■ responsibilities and about learning/ . 
school in general, increased achievement in magtery/retention of facts and 
skills and in test scores, and benefits from better instruction which provides 
a structured, consistent lesson format. 

Survey respondents in general felt that AT had somewhat of an impact on 
students in terms of better attitudes and achievement, with mean responses 
ranging from 3.59 to 3.88 on a scale from 1.00 (strongly disagree) to 5.00 
■ (st-rongly agree). (See Table 14.) However, these responses were not as high 
as the responses given to classroom and teacher impact. Teachers were consis- 
tently lower in their ratings of student impact than were central office 
staff, except in their ratings of the statement that "students' achievement 
has increased" where teachers' ratings were fairly consistent with the ratings 
given by the other two role groups. 

Affective measures of student impact were submitted by three of the 
seven LEAs. (Two additional LEAs submitted results from their own surveys of 
student attitudes toward AT.) Cecil and St. Mary's counties gave their 
students the Student Questionnaire. The questionnaire consists of seven 
questions of dimensions (i.e., recognition of differences, understanding of 
lessons, enjoyment of lessons, ease of lessons, learning of lessons, better 
grades, and better lessons). Respondents answered using a five-point scale 
ranging from 1.00 (not at all) to 5.00 (yes a lot). There are ele:,..ntary and 
secondary versions Of the questionnaire.. 
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in (Jecii ComTtyTTjoth -Oie^elen^ K-3:)-~ang-sccona ^y (gr ades 

4-12) versions of the questionnaire were administered at the end of AT imple- 
mentation (post). As can be seen in Table 16, the mean scores for all seven 
dimensions were positive on both versions of the questionnaire. The mean 
scores of the younger students ranged from 3.13 (ease of lessons) to 4.68 
(recognition of differences between AT lessons and lessons taught prior to AT 
implementation). The mean scores of the older students ranged from 3.71 (ease 
of lessons) to 4.50 (understanding of lessons). 

In St. Mary's County, the secondary version of the questionnaire was 
given to students in 16 different classes taught by eight teachers half-way 
through the year (mid) and again at the end of the year (post). As can be 
seen in Table^ 16, mean scores on the mid-year administration of the question- 
naire were positive for all seven dimensions and ranged from 3.20 (better 
grades) to 4.04 (understanding of lessons). Mean scores on the post test were 
also pdsitive ranging from 3.36 (better grades) to 4.23 (understanding of 
lessons) . Mean scores on the questionnaire increased (became more positive) 
between the mid-year and end-of-year administrations for all seven dimensions 
(especially for three dimensions: learning of lessons, ease of lessons, and 
better lessons) . 

Caroline- County used the My Class Inventory (MC) to measure affective 
student impact. The inventory was given to approximately 524 elementary 
students prior to AT implementation (pre) and 573 elementary students af':er 
implementation (post) . 
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Table 16 



Student Attitud 



'^^(S^^^^^^Mionnaire) : Active Teaching, 




3' Enjoyment of lessons 

^. Ease of lessons 

5' Learning of. lessons 

^' Better grades 

7« Better lessons 



score, the 
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Table 17 

Student Attitudes ( My Class Inventory ) ; Active Teaching, 1982-83 



^^"^"^^.^^^ LEA 


Caroline 


Dimensions ^'^^*>.^^^ 


Pre 


Post 


% Yes 


%.No 


% Yes 


% No 


1, Competitiveness 


75 


25 


70 




30 


2, Satisfaction • 


68 


32 


65 




35 


3. Difficulty 


38 


62 


36 




64 . 


4. Friction 


69 


31 


65 




35 



The MC is an.element^ry version of the Learning EnvironmP .nt Tnvpntn.., 
It consists of 45 items measuring five dimensions. Four dimensions were 
relevant for assessing AT impact on student attitudes (i.e.. competitiveness, 
satisfaction, difficulty, and friction). Responses are "yes" and "no" and the 
higher the percent of "yes" answers, the higher the agreement with the dimen- 
sion being measured. High, agreement is desirable for satisfaction, and low 
agreement for difficulty and friction. Desirable scores on competitiveness 
depend upon individual school philosophies. 

There Was very little difference between scores on the pretest and post- 
test indicating that student attitudes about their classes did not change 
after AT implementation. On both the pretest and posttest., agreement was high 
for competitiveness, satisfaction, and friction and low for difficulty, 
indicating that students liked to compete, enjoyed their classes, felt that 
there were tensions among certain groups of students that ..-ended to interfere 
with class activities, and felt that the work of the class was not too 
difficult. \ \ 
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Garrett County administered its own attitude survey to students involved 
in AT. Results showed that AT students were more satisfied with instruction 
and had more positive attitudes about their class in comparison with a control 
group of students not using AT. 

In Wicomico County, teachers were asked to complete a questionnaire after 
two and one-half months of AT implementation. They were asked to summarize 
their students' attitudes about AT. Some of the teachers' responses were: 
class likes it, students feel secure, students look forward to class , students 
are increasing their self confidence, and students like the routine. 

Harford and Montgomery Counties did not submit affective data. 
However, both counties had received informal positive feedback about AT from 
students. 

Cognitiv e measures of student impact were submitted by three of the seven 
LEAs: Garrett, Montgomery, and St. Mary's counties.* 

Garrett County submitted pre and post mean scores on a criterion- 
referenced test for seven AT classes at Northern High School. For all seven 
classes, scores increased^ from pre to post and the differences between pre and 
post test mean scores ranged from 12.77 to 47.07 points. 

At Southern High School, the pre and post test mean scores of three 
experimental and control groups were compared. For two of the three experi- 
mental/control groups comparisons, AT students (experimental) made substan- 
tially larger gains than non-AT students (control) between the pre and post 
test. 



* While CAT scores for the students in Belmont Elementary for October 1982 
were submitted by Montgomery County, they are not discussed here since no 
related data (e.g., post scores, trend analysis) were provided. 

llo 



St. Mary's County compared the mid-term -^and find grades of students in 
nine AT classes and two control classes. Thirty-eight percent of the experi- 
mental students' grades increased from mid-term to final grade compared to 
only 8% of the control group's grades. While 62% of the experimental 
students' grades dropped between mid-year and the end of 'the year, 92% of the 
control group's grades decreased. 

Caroline and Wicomico counties were not required to submit cognitive 
data. Cecil County did not formally look at cognitive impact because AT had 
spread widely and it was too difficult to isolate students at;d teachers for 
placement in experimental and control groups. 

No cognitive data were received from Harford County. Harford has 
conducted a longitudinal study with six schools (two schools . scoring at each 
.of three levels - top, middle, low - on the CAT) comparing third and fifth 
grade CAT scores in mathematics. There were significant gains on CAT scores 
at both the lower and middle scoring schools. 

Direct "cause and effect" claims for AT impact on student achievement are 
difficult to make on the basis of the above data and test designs used. 
However, many students are mastering the material and believe that their 
comprehension and competence have improved, and this can be attributed in part 
to AT. 

Participant Concerns 

Two types of concerns were expressed by AT implementers: model-specific 

and-implementation--pr-o^e-ss-corrcer^^^^^ 

menters expressed model-specific concerns with the most common beir.^ that AT " 
was too structured/monotonous and could inhibit a teacher's creativity. The 
most common implementation concern was that persor,ael and resources were not 
being used (or available) to meet project needs. 
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Concerns /Problems 



Chart 2 
Reported: Active 



Teaching, 



1982-83* 



Model concerns 

Time allocations too rigid/lack of time for students having 
problems (4) 

Not apt>licable for all subject areas/classrooms (4) 

Too structured/monotonous/inhibits a teacher's creativity (6) 

Children checking & grading homework (which may not have been done 
independently) (2) 

Does not cake individual differences into account/may hold back 
academically talented students (1) 

Implementation concerns 

Coordination of effective activity, design, materials development, and 
classroom management (3) 

Personnel and- resources not used (or available) to meet oroiect 
^ needs (5) 

Teachers not actively engaging students in learning (1) ' 



Figures in parentheses "indicate the number of LEAs making a given statement, 



0 

106 

lis 



Suggested recommendations Csee Chart 3) fell, into four categories: 
classroom implementation, implementation/preparation, expansion, and external 
assistance. The most common recommendation" was to expand to other classes/ 
subjects/teachers/schools. However, many respondents stated that before, 
expanding, LEAs should try to implement the other types of recommendations 
(i.e., implementation and external assistance). 
Conclusipns and Summary 

In the preceding pages, each research question or issue has been 
addressed and findings have been discussed across LEAs. Some issues and 
conclusions are presented below. Then, findings for each LEA ara discussed. 

It is apparent • that almost all LF\s implementing AT were strongly 
committed to its effective use in a large number of classrooms, and employed 
strategies both to train teachers and to ensure school-based administrators 
and central office staff could observe and supervise AT classes effectively. 
The level of fidelity was high, implementation was long term and consistent 
for given subjects and grades, and teachers understood the relative instruc- 
tional value of components. Although seemingly simple, AT became a challenge 
when teachers understood the implications involved (especially coordinating 
activities, materials, and management strategies for each component to main- 
tain time-on-task) . Although AT was used in many subject areas, the greatest 
Impact was made in mathematics.* 

Impact was made on student achievement when AT was used in appropriate^ 
subjects or units, and when the teacher paced the students through the 
components at a level of instructional difficulty appropriate for t^e majority 



* AT was designed primarily for mathematics instruction. Also, the MSDE TA 
for AT is a mathematics specialist and can readily provide assistance in 
this area. 
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\ Chart 3 

Recommendations/Solutions: Active Teaching, 1982-83* 



Classroom Implementat ion 

chicklngro ^^^P^^ti^^ (^-g- spotcheck. Instead of full class 

Maintain fidelity (and monitor) (2) 

Allow sufficient. time, adjust time allocations (3) 

Provide resources (material) (1) 

Have ability or homogenous grouping (2) . 

Develop strategies to deal with absentees (1) 

Implementation/preparation 

Implement for the full year (3) ' 
Reduce paper worl^ (l) 

Provide trainlr. A assistance (e.g., by content areas) (3) 
Evaluate effecrve ess (1) / v / 

Expansion „ 

Use every day (1) 

Expand to other classes/subjects/teachers/schools (6) ■ 
Try another model (2) 

External assistance 

Provide ins'ervice (1) 

Keep locals informed about research on teacher effectiveness (n 
Increase funding (1) ^ 
Increase central office support (1) 

Increase cooperation between MSDE and central office to help teachers 
solve problems (1) ^ •-cduuei-s 



Figures in parentheses indicate the number of LEAs making a given statement 
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of the students. (This is difficult in heterogeneous classes with wide ranges 
of ability.) Students' attitudes about their ability to learn, and apprecia- 
tion for well-organized lessons increased when AT was used with fidelity. 

Impact was made on individual teachers' knowledge (research on classroom 
effectiveness and its relationship to AT) through training. Skills improved 
(in use of time, development of activities for the "review" component, and the 
coordinated management of learners and learning), through on-site practice 
accompanied by follow-up assistance. Self-confidence in their teaching 
ability increased when their efforts were acknowledged by administrators and 
supervisors. ^ . 

Impact was made on a school (the faculty and how instructional matters 
are dealt with) when several teachers are involved, and when it was under- 
stood that AT was to be used for a given subject or. unit. In elementary 
schools, it appeared to be important for principals to understand and advo- 
cate use of AT (e.g., for mathematics), and conduct' observatio.ns related to AT 
components (providing appropriate recognition for success). In secondary 
schools, it appeared that the principals' understanding and advocacy was" 
important in es'tablisTaing the reality of implementation, but subsequently 
faculty looked to each" other (e.g.. by subject "teams") for interactive 
support. (This difference is less likely to be related specifically to AT 
than to the dififerent organizational structures and teacher isolation of 
elementary and secondary schools.) 

The strategies used to provide interactive support and maintain energy 

to implement or expand AT were as Important as the perceived value of the 
model. Positive impact was made when teachers were given training and follow- 
up assistance that related to thsir expressed needs and interests; when 
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administrators understood, advocated, and acknowledged fidelity implementa- 
tion; when teachers had time and skill (with assistance if necessary) to 
coordinate and develop activities, materials, and management strategies to fit 
components and student needs; and when central offi-.o staff clearly and 
consistently communicated the nature and extent of their interest in the 
success of AT, acknowledging successes and taking action to help overcome 
problems encountered. Positive impact was reduced or barriers created when: 
central office staff maintained administrative control but expected everything 
else to be done by school-based staff; centralized mandates were made^with 
insufficient attention to building commitment and a sense of ownership by 
school staff; the program was "energized" by one key person whose influence 
was limited (e.g., if he/she was reassigned, or was school-based) , with the 
result that time and effort was then needed to build capacity and interest of 
others. 

In the following case reports of the LEA5 implementing AT, attention is 
given to the influential factors mentioned above and also to specific 
objectives and results achieved in each county.* 

Caroline County . Caroline has' been implementing AT for one year using a 
lighthouse school strategy. In September 1982, educators "hoped" to achieve 
five objectives specified in Table 8 (i.e., improving student achievement in. 
basic skills, informing local educators about AT, training local educators to 
use -AT, improving teachers' classroom competence, and improving time-on-task'). 
In June 1983, four of the five objectives had been "partly achieved" (the 



u^i^ information vary, in part because, two LEAs were pilot sites of 
d^Jf RBS to visit, and in part because some LEAs provided more 

documentation or other evidence of model implementation and improving 
student involvement in learning. f ^ 
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exception was improving student achievement In basic skills which was no 
longer indicated as an objective in June), Two additional objectives not 
ment-loned- in-September-were -also ^part-ly~-aGhievedi^-(i-^e. i-helping-teachers 
become better organized and improving students' involvement in learning) . 

• Scope and Intensity , After the first year of AT implementa- 
tion (June 1983), AT was being used in two elementary schools 
by fiye teachers and 122 students in mathematics, 

• Fidelity , Teachers consistently addressed all six components 

of the AT model. The largest number of teachers felt that the. . 
pre-lesson development was the AT component having the great- 
est impact on students, 

• ms^- Educators spent an average of 10 months involved in AT 
across the 1982-83 school year. Teachers reported spending an 
average of 29% of their school week on AT-related activities. 
AT required teacheirs .to spend about the same amount of time 
preparing students (e^g., grouping, pre-testing) and allowed 
somewhat more time for curriculum coverage than had similar 
previous instructional methods. * 

School administrators spent an average of seven days and 
central office staff an average of four gjid one-half days on 
AT. School administrators felt AT. took "about the same" 
amount of time an'H energy, while central office reported 
"slightly less" effort on AT in comparison to similar previous 
proj ects. 

• Roles and Responsibilities . School administrator?? and central 
office staff combined spent the least amount of time and ' 
energy on materials development (1.83)* and the most effort on 
inservices and evaluation (3.33 for each activity). School 
administrators, spent the least amount of time on administra- 
tion (1.75) and the most effort on inservices and evaluation 
(3.25 for each activity). Central of fice^ staff spent the 
least time on materials development (1.50) and the most effort 
on inservices, supporting school implementation, dissemina- 
tion, and evaluation (3.50 for each activity). 

Training was done by MSDE, central office staff, and school- 
based staff (teachers and school administrators). Educators 
rated the interactive support received from the five role 
groups involved in SITIP as average and above. MSDE recei.^ed 
the highest ratings and developers the lowest ratings of 
support. (Staff of this LEA had no interaction with AT 
developers.) By the beginning of June 198^, : .. .-rmation had 



Level of effort (time and energy) was rated on a scale from 0 (none) to 
5,00 ^(a great deal). 
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been received by all central office staff, 50% of the school 
administrators, and 25% of the teachers^ Training had been 
received by 75% of the central office ^taff and school admin- 
istrators.and by 25% of the teachers. Twenty-five percent of 
the school administrators and teachers had received help . 

• Impact . AT has had an impact on .training and on the school 
system, the school, the educators, and the students involved. 
In the area of training , the majority of teachers felt that 
they understood the model. 

AT impact on the school system was the policy decision to 
actively encourage use of the model district -wide for elemen- 
tary mathematics. School level impact included greater 
continuity/ consistency of instruction for mathematics, teacher 
enthusiasm and sharing, and a structured daily program/ 
improved management system. 

School administrators felt that AT involvement enabled them to 
learn about a new teaching technique and to become better 
organized. 

Educators indicated that AT has had an impact at the classroom 
^level 'in terms of a structured, consistent format. 

Teachers increased their knowledge of the components of 
effective teaching, improved their skills in a new teaching 
technique, in organization/ structure/planning/pacing, , and in 
the effective use of time, and strengthened their confidence 
and self-image. 

Educators were unsure as to whether use of AT had resulted in 
increased student achievement durint^ the first year of imple- 
mentation. Affective student impact was perceived by educa- 
tors in terms of improved attitudes about school, enjoyment of 
AT, and somewhat better/less disruptive behavior. Results 
from the My Class Inventory indicated that students in AT 
classes did not have difficulty with the lessons, were fairly 
satisfied, and reported slightly less competition and friction 
by the end of the year than they had first perceived. 

• Concerns and Changes . Caroline educators expressed both model 
and implementation concerns* Some educators felt that the 
time allocations were too rigid, that the model was too 
structured, and could inhibit a teacher *a creativity, that the 
model may hold back academically talented students, that AT 
was not applicable for all subjects/classrooms, "and that 
personnel and resources were either not hieing used or were not 
available to meet project needs. 

Suggested recommendations included developing strategies to 
deal with absentees, evaluating the effectiveness of the 
model,, and expanding AT to other classes/ subjects/teachers/ 
schools. 
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Factors influencing relative success included: 1) strong central office 
support; and 2)opportunity and willingness to learn from "veteran" AT imple- 
menters. Concerns expressed suggest that educators may need to explore use of 
resources and the extent which teachers believe that their ideas and needs 
are considered for the project. Caroline has made good progress for its first 
— year-of--itaplementation, 

Cecil County , Cecil has been implementing AT for two years using a pilot 
district strategy. In September 1982, educators "hoped" to achieve seven of 
the nine objectives specified in Table 8 (i.e., improving student achievement 
in basic skills, informing local educators about the model,, training local 
educators to use the model, improving teachers' classroom competence, helping 
teachers become better organized, improving time-on-task, and improving 
students' involvement in learning). In June 1983, two of these seven 
objectives had been "partly achieved" (i.e., improving teachers' classroom 
competence and improving students' involvement in learning). The remaining 
five objectives were "achieved." 

• Scope and Intensity . After the first year of AT implementa- 
tion (June 1982), AT was being used in four schools (2 elemen- 
tary and 2 junior high/middle schools) by approximately 20 
teachers and 450 students in reading/language arts and raathe- 
Bjatics. In June 1983, 17 schools, 40 teachers,, and 2,000 
students were involved in AT. „ ^ 

• Fidelity . The only AT component not consistently addressed by 
all the teachers was weekly or monthly end of unit reviews. 
The largest number of teachers reported that controlled 
practice was the AT component having the greatest impact on 
students. 

• iiSS.* Educators spent an average of 8 months involved in AT 
across the 1982-83 school year. . Teachers reported spending an ^ 
average of 25% of their school week on AT-related activities. 

School administrators spent an average of 10 days and central 
office staff an average of 12 days on AT. School administra- 
toi^s reported that AT took "slightly less" time and energy and - 
central office staff reported "slightly more" effort on AT in 
comparison to similar previous projects. 
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• Roles and Responsibilities , School administrators and central 
office staff combined spent the least amount of time and 
energy on dissemination (2 .30)* and the most effort on 

.supporting school Implementation (3.30). Central office staff 
^ spent the least effort on materials development and dlssemlna-- 
tlon (3.00 for each activity) and the most effort on Inser- 

vice~(5 . 00)'~. ^SchdbT' admlirr^^ 

energy on Inservlce (1.86) and the most effort on supporting 
school Implementation (2.86). 

. Most of the training was done by central office staff, ^ 
although a few teachers were also trained by the developer, 
MSDE, and school-based staff (school administrators and 
teachers). Educators rated the Interactive support received 
from the five role groups Involved In SITIP as average and 
above. Central office staff received the highest ratings and 
developers the lowest ratings. By the beginning of June 1983, 
Information had been received by 100% of the central office 
staff, and by about 75% of the school administrators and ^ 
teachers. Training and help had been received by 100% of 
central office staff and school administrators and by about 
50% of the teachers. 

• Impact . AT has had an Impact on training and on the school 
system, schools, educators, and students Involved. In the 
area of training , the teachers reported that they understood 
the model. A large number of them felt that their teaching 
ability had Improved^ as a result of thcrlr Involvement In AT. 

AT Impact on the school "system Included policy decisions to 
use AT In certain subjects/grades district-wide, and greater 
emphasis on staff development. School level Impact Included 
^greater continuity/consistency within those subject areas and 
teachers usin^ AT, teacher enthusiasm and sharing, and a 
structured daily program/ improved management system. 

Central office staff felt that involvement in AT enabled them 
to learn about a new teaching technique. School administra- 
tors experienced the satisfaction of being part of a success- 
ful project, and became aware of an effective method of obser- 
vation/supervision. 

Educaitors indicated that AT has had an impact at the classroom 
level in terms. of a structured, consistent format, clear 
teacher expectations, the use of effective learning activi- 
ties, more individualized attention, and better use of time. 

Teachers increased their knowledge of the components of 
effective teaching and improved their skills in organizatic*., 
structure, planning, pacing, the effective use of time, the 

Level of effort (time and energy) was rated on a scale from 0 (none) 
5.00 (a great deal) . 
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components of effective teaching, assessing and addressing 
student needs, and instruction in general. Teachers' 
confidence and sense of efficiency increased, as did their 
belief in the value of traditional teaching techniques. 

Increased student achievement was perceived to some degree by 
educators in terms of grades and increased mastery/retention 

of - fa c tns- an^d^-ski-i-lsr; — A-ffec1rLve— student- ±mpact-va s-p o s±t±v e-in 

terms of student enjoyment and better/less disruptive 
behavior. 

• Participant Concerns , Educators expressed both model and 
implementation concerns. Some educators felt that AT is not 
applicable for all subject areas/classroom and that it 'can 
inhibit a teacher's creativity. They were concerned about 
children checking and grading homework which may not have been 
done independently. Teachers expressed a concern over the 
ability to coordinate effective activity design, materials 
development, and classroom management. 

Recommendations/solutions dealt with classroom implementation 
(i.e., allow sufficient time, provide resource materials, and 
group students by ability), implementation'/preparation (i.e., 
implement for the whole year and provide continued training 
and assistance), and expansion (i.e., use everyday, expand 
to other classes/subjects/teachers/schools, and try another 
model). 

Factors influencing relative success included: 1) strong central office 
support, particularly in training teachers and providing follow-up assistance 
2) involvement of school-based administrators in supervisory-support roles; 
and 3) teachers' professionalism. Educatora may need to address concerns 
about homework and coordination of activities, materials, and management in 
the classroom. (The latter may be alleviated if ability grouping is used for 
AT mathematics.) 

Garrett County . Garrett has been implementing AT for two years using a 
lighthouse school strategy. In September 1982 educators "hoped" to achieve 
all of the objectives specified in Table 8. In June 1983, these obiectives 
were "partly achieved". 

• Scope and Intensity > After the first ye^ r of AT implementa- 
tion (June 1982), AT was being .usod in one high school by five 
teachers and 281 students in ma:tAematics and science. In June 
1983, eleven teachers, and 443. rxuaents in two high schools 
Vere using AT inia*vdriety of subjects. 
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• Fidelity , None of .the six AT components were addressed by all 
the teachers. However, no component was addressed by less 
than 78% of the teachers. The two components least addressed 
were controlled/guided practice and homework assignments. The 
largest number of teachers reported that the Independent prac- 
tice was the AT component having the greatest Impact on 

- ~ — students-. — - .-.^ 

• Time. Educators spent an average of seven months Involved In 
AT across the 1982-83 school year. Teachers reported- spending 
an average of 31% of their school week on AT related activi- 
ties. 

School administrators spent an average of three days, and 
central office staff an average of 20 days on AT. Central 
office staff reported that AT took "slightly less" time and 
energy and school administrators reported "about the same" 
effort In comparison to similar previous projects. 

• Roles and Responsi bilities . School administrators and central 
office staff combined spent the least amount of time and energy 
on materials development (2.50)* and the most effort on 
administration (4.00). School administrators spent the least 
effort on materials development (1.50) and the most time and 
energy on administration^ Inservlce, and supporting school 
Implementation (3,00 for each activity). Central office staff 
spent the most effort on administration (5,00) and the least 
time on materials development (3.50). * 

Most of the training was done by MSDE, although some of the 
teachers also received training from the developer , central 
office staff, and school administrators and teachers. 
Educators rated the Interactive support received from the' five 
role groups Involved in SITIP as average and above. Central 
office received the highest and developers the lowest ratings 
of support. By the beginning of June 1983, information had 
been received by 50% of the central office staff, 75% of the 
school administrators and 100% of other faculty at the two 
high schools using AT. Training had been received by 50% of 
the central office staff, and 75% of the school administrators 
and 25% of the teachers at the pilot schools had received 
training and help . 

I Impact. AT has had an impact on ttainitig and on the school 
system, schools, educators, and students involved. In the 
area of trainlng^, 89% of the teachers reported that they 
understood the model and 33% reported that their teaching 
ability had improved as a result of their Involvement in AT. 

As^a result of SITIP, the school system became more aware of 
the research on school improvement and effective teaching. 



Level of effort (time and energy was rated on a scale from 0 (none)- to 
5.00 (a great deat^ ^ / u 
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School level Impact was felt in terms of closer monitoring/ 
, supervision of lessons by principals and supervisors. 

Central office staff reported that AT enabled them to become 
better organized, and school administrators reported that AT 
strengthenecf their conviction that traditional instruction 
works . 

Classroom level impact (e.g., AT is a worthwhile, workable " 
instructional model) was perceived by educators in terms of a 
structured, consistent format, clear teacher expectations, and 
the use of effective learning activities^. 

Teachers increased their knowledge of the components of 
effective teaching and improved their skills in a new teaching 
technique; in organization, structure, planning, ' and pacing; 
in the effective use of time; in the components of effective 
teaching; in assessing and addressing student needs;and in 
instruction in general. Teachers also strengthened their con- 
victions about^the benefits of traditional teaching 
techniques. 

Increased student achievement was perceived in terms of 
mastery/retention of f^cts and skills and evidenced in results 
from teacher made tests* At one school, .two out of three AT 
classes made greater gains on tests than did control classes. 
At the other school, pre to post gains for AT classes ranged 
from 12.77% to 44.77%, with all class means above 53% on the 
post^test. (Local evaluators stated "Greatest learning gain 
appears to correlate with" degree of implementation of the 
model's major components," and "Students identified more 
organized instruction as the' major contributor to increased 
student learning.") 

Affective student impact was perceived in terms of improved 
attitudes about learning responsibilities. AT students 
reported satisfaction with instruction, increased self 
confidence, belief that they were learning more, and belief 
that more content was being taught. ' For the 1982-83 year, 
between 50% and 83% of the AT students in both sc'iools agreed 
in those four areas, (wifh a higher mean score in the second- 
year site), while between 31% and 68% of the control students 
made such responses. (Locial evaluators concluded "Experimen- 
tal students ... were more satisfied with; instruction than 
were their control counter parts.") , ^ \ 

Participant Concerns . Educators expressed concerns that AT is 
not applicable for all subject, areas/classrooms, and that AT 
is so structured it can inhibit a teacher's creativity. Ir* 1 
the area of implementation, educators Were concerned about 
personnel and resources not being used <or available) to meet 
project needs . , . 
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Suggested recommendations fell Into four categories: ' 'class- 
room Implementation (I.e., allow Instructional adaptation); 
Implementatlon/prep^iratlon (I.e., Implement for the full 
year); expansion (I.e., expand to other classes/subjects/ 
^ teachers/schools) ; and external assistance (I.e., provide 
inservice) . 

"Factors-ltifluenelng-reiat-lvfr -success-Included ^__L)__the_^^ 
to existing beliefs of many local educators about effective teaching (rein- 
forcing commitment); 2) staff reassignments (e.g., the "loss" of the school- 
based coordinator) which made heavy demands on the MSDE TA to provide training 
for expansion and assistance for capacity building; and 3) centrial office 

c ■ 

responsiveness to MSDE assistance, and support for the project , including 
investment in evaluation to determine the objective value of AT. The recom- 
mendations made in the local evaluation report Include "... support continued 
use of the model on a voluntary basis," and "perhaps it (the model) can be 
adapted more easily to some content areas ... than to others." Local 
educators may also want to review their allocation of staff and time related - 
to AT in light of these concerns and in order to increase their own capacity 
for training and assistance in support of implementation. 

Harford County . Harford has been implementing AT for two years using a 
district-wide strategy. In September 1982, educators "hoped" to improve 
teachers* classroom competence and had "partly achieved" Improvement in 
student achievement in mathematics. In June 1983, Improving student achieve- 
ment remained "partly achieved" and improving teachers' classroom competence 
was "achieved", especially at the elementary level. 

^ • Scope and Intensify > After the firsts year of implementation 
(June 1982), AT wafi( being used in all (26) elementary schools 
by 434 teachers^andy 1,910 students in nuathematics. By June 

; IS83, all of the middle schools were also using AT: a total of 

34 schools, 446 teachers and 19,177 students in mathematics, 
grades K-8. ' 

" - / 
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Fidelity , The majority of teachers Implemented AT with a high 
degree of fidelity using all six components. 

• lis®- Educators spent, an average of eight months Involved 
In AT across the 1982-83 school year. Teachers reported 
spending an average of 51% of their school week on AT-related 
activities. (Middle school subject specialists spent much 

more time on AT Jhan^l d eleme nt aryjt eac hers. ) Edu cators did 

not think t;hat AT required more time for preparing students 
(e-g-» grouping, pre-testlng) and were unsure about whether 
the curriculum could be covered In a shorter amount of time 
using AT. 

Central office staff spent an average of 23 days on AT. They 
reported that AT took about the same amount of time and energy 
as had similar previous projects. 

• Roles and Responsibilities . School administrators and central 
office staff combined spent the least amount of time and 
energy (level of effort) on evaluation (2.43)* and the most 
effort on Inservlce (3.57). Central office staff spent the 
most effort on administration, materials development (for 
training), and liiservlce (4.33 for each activity) and the 
least effort on evaluation (3.67). School administrators 
spent the least time on administration (.67) and the most 
effort Inservlce (3.00). 

Most of the training was done by central office staff and some 
by school administrators and the MSDE TA. Educators rated the 
Interactive support of the five role groups Involved In AT as 
average and above. Centr'al office staff received the highest 
ratings and MSDE the lowest ratings. MSDE trained and 
provided assistance to central office staff and received high 
ratings of support from this role group. By the beginning of 
June 1983, all educators In grades K-8 had received 
Information , training , and help . 

• Impact . AT has had an Impact on the school system, schools, 
educators, and students Involved. The school system has 
benefitted by the Improved communication, sharing, and 
cooperation among educators across the district. Children are 
grouped by ability no facilitate AT Implementation. At the 
school level there has been closer monitoring/ supervlsf on of 
lessons by principals and supervisors, and a better definition 

. \ of^studerit and teacher roles. 

Central office staff and school administrators felt that AT 
gave them a means of helping Ineffective teachers. 

Educators Indicated that AT has had an Impact at the classroom 
IQVQI in terms of more opportunity for Independent work and 
better use of. time/more material covered. 



* Levels of effort (time and energy) was rated on a scale from 0 (none) to 
.5.00 (a" great deal). / 
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Teachers Increased their knowledge of the components of effec- 
'tive teaching and improved their skills in a new teaching 
technique; in. organization, structure, planniiig, and pacing; 
in the effective use of time; in the components of effective 
teaching; in assessing and addressing student needs; and in 
instruction in general. 

Increased student achievement was perceived by educators in 

terms of test-scores. — A -longitudinal, study showed significant 

gains on third and fifth grade CAT scores, especially for 
students attending schools that traditionally have low scores. 

Affective student impact has been felt in terms of better/less 
disruptive behavior and improved attitudes about school. 

• Participant Concerns . Some concerns expressed by educators 
included the following ; 

- time allocations are too rigid 

- AT is too structured, can inhibit a teacher's creativity 
children checking their own homework (which may not have 
been done independently) 

' - personnel and resources are not used (or available) to meet 
; project needs 

- some of the teachers may not be actively engaging students 
in learning. 

Recommended changes fell into two categories: classroom ~- 
implementation (i.e., allow situational adaptation, maintain 
and monitor fidelity, allow sufficient time) and expansion 
(i.e., expand to other classes'/subjects/ teachers/schools). * 

Factors influencing relative success included: 1) very strong central 

office support, particularly in providing training and follow-up assistance 

(although a little more attention to school administrators in the middle 

schools would have helped to overcome initial resistance); 2) use of various 

sources of information on school and classroom effectiveness to reinforce AT, 

especially among administrative staff, and 3) attention (by central office 

staff and school administrators) to assessing the subjective and objective 

value of AT and making appropriate data-based decisions (e.g., to address 



teachers' concerns) and claims (/e.g., that AT works best when students are 

/ 

grouped by ability, and can make great impact on low-achieving students). 
Toward the end of the school year, budget cuts were made and a new project 




coordinator was assigned. 
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Montgomer y County ,* Montgomery has been implementing AT for two years 
using a lighthouse school strategy. In September 1982, educators had 
"achieved" improvement of student achievement in' the basic skills and had 
"partly achieved" six other objectives specified in Table 8 (i.e., improving 
student achievement in other subjects, improving teachers' classroom 
competence, ensuring curriculum alignment, helping teachers become better 
organized, improving time-on-task, and improving students' involvement in 
learning). By June 1983, all of these six "partly achj^ed" objectives were 
"achieved" along with the additional objective — informing local educators 
about AT. 

• Scope and Intensity . By June 1983, AT was being used in one 
elementary school by five teachers and. 180 students in 
reading/language arts and mathematics. In June 1983, four 
more teachers In the same school were using AT. These 
teachers are also implementing- Teaching Variables. 

• Fidelity. The two AT components that were not consistently 
addressed by all of the teachers were pre-lesson and lesson 
development. 

• Time. Educators spent an average of nine months involved 
in AT across the 1982-83 school year. Teachers reported 
spending an average of 38% of their school week on SITIP- 
related activities (AT and TV). Educators were unsure as to 
whether AT required more time ^ for preparing students (e.g., 
grouping students, pre-testing) or if curriculum could be* 
covered in a shorter period of time using AT. 

Central office staff spent an average of 20 days on SITIP.** 
Central office staff and school administrators reported that 
SITIP took "substantially more" time and energy than had 
similar previous projects. 

• Roles and Responsibilities . School administrators and central 
office staff combined spent the least amount of time and 
energy on materials development and dissemination (1.50 for 



.* This school, site combined use of AT and TV. Results cannot be attributed 
to the implementation of a single model. 

** Central office staff were involved with more than one model. ^ . ^ 
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each activity)* and the most effort q,n administration and 
supporting school implementation (4.00 for each activity). 
School administrators spent the least time and enefgy on 
dissemination (2.00) and the most effort on administration, 
inservice, supporting school implementation, and evaluatjon 
(4.00 for each activity). Central office staff spent no time 
on materials development and the most time and energy on 
administration and supporting school implementation (4.00 for 
each activity) . " 

Most of the training was done by school administrators and 
teachers, although some teachers received training from the 
developer and MSDE. Educators rated the interactive support 
received from the five role groups '^involved in SITIP as aver- 
age and above (with the exception of support from central 
office staff). Teachers and school administrators received 
the highest and central office staff the lowest ratings of 
support. By the beginning of June 1983, at the pilot site, 
information and training had been received by. all school 
administrators and teachers and by 10% of central office staff 
and other faculty: Help had been received by all school 
administrators, 50% of the teachers, and 10% of other faculty 
at the pilot site. 

! 

Im£act. AT has had an impact on training and on the educators 
and stjidents involved. In the area of training , teachers felt 
they understood the model. 

School ad ministrators felt that thsir involvement in AT 
enabled them to learn about a new teaching technique and to 
experience the satisfaction of being part of a successful 
project. 

Educators indicated that AT has had an impact at the classroom 
level (e.g., AT is a worthwhile, workable instructional 
model) . 

Teachers have increased their knowledge of and skills in 
applying the components of effective teaching and have also 
improved their skills in assessing and addressing student 
needs. 

, T 

Increased student achievement has been perceived by educators 
in terms of test scores.\ : Affective student impact has been 
felt in terms of enjoyment of the model and improved student 
attitudes about school. ;V 

■ \ ■/■-. 

Participant Concerns. : EdUcators expressed a concern that time 
allocations were often; too rigid. They recommended that 
funding and central, off ice support should be increased. 
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Factors influencing relative success included: 1) the energy and commit- 
ment of the principal. 2) the teachers' professionalism, and 3) use of various 
sources of information on school and classroom effectiveness to reinforce' AT. 
This project was essentially school-based, and staff felt little relationship 
to other "school effectiveness" activities initiated by central office staff, 
in spite of "spin off" activities organized by the principal for professional 
groups in the county. Stated objectives were achieved and so participants 
experienced success from a rational perspective. However,' they were 
disappointed by a perceived lack of active involvement by central office 
staff. 

St. Mary's County. St. Mary's. has been implementing AT for two years 
using a capacity building strategy. In September .1982, educators "hoped" to 
achieve four objectives specified in Table 8 (i. e. , improving student achieve- 
ment in basic skills and in other subjects, improving time-on-task, and 
improving students' involvement in learning). Four objectives were "partly 
achieved" (i.e.. informing local educators about the model, training educators 
to use the model, improving teachers' classroom competence, and helping 

« 

teachers become better organized). In. June 1983, two objectives were still 
"hoped" for (i.e., improving student achievement in basic skills and in other 
subjects). The other six objectives were "partly achieved." 

• Scope and Intensity. After the first year of implementation 
(June 1982), AT was being used in one high school by nine ' 
teachers in a variety of -subjects. In June 1983, AT was in 
five schools (elementary ind secondary) . Twenty-seven 
teachers were using AT in various subject areas. 

• Fidelity. The AT component addressed by the largest percent- 
age of teachers (87%) was lesson development. Controlled/ 
guided practice was addressed by the fewest number of teachers 
(67%). The remaining four components were addressed by at 
least 73% of the teachers. The largest number of teachers 
reported that pre-lesson- development was the component having 
the greatest impact on students. 
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Time * Educators spent an average of seven months Involved in 
AT across the 1982-83 school year. Teachers reported spending 
an average of 63% of their school week on AT-related ^activi- 
ties. AT required teachers to spenc more time preparing 
students (e.g., grouping, pre-testing) in comparison to other 
instructional processes. 

♦ School administrators spent an average of two days and central 
office staff an average of four days on AT. School adminis- 
trators reported that AT took about the same amount of time 
and energy, while .central office staff reported spending less 
effort on AT in comparison to similar previous projects. 

Roles and Responsibilities . School administrators and central 
office staff combined spent the least time and energy on 
materials development (1,44)* and the most effort on dissemi- 
nation (2.78). School administrators spent the least time on 
materials development (2.00) and the most effort on supporting 
school implementation (3.00)., Central office staff spent the' 
least effort on materials development (1,17) and the most time 
and energy on dissemination (2.83). 

Most of the training was done by school-based staff (school 
administrators and teachers). . The two teacher coordinators 
for the project have done the majority of the training, A 
"buddy" system is used for coaching. Educators rated the 
interactive support received from the five rola groups 
involved In SITIP as average and above.^ Central office staff 
received the lowest ratings and teachers the highest ratings 
of support. By the beginning of June 1983, information had 
been received by all central office staff and school adminis- 
trators and by 50% of the teachers. Training had been 
received by 50% of the central office staff. Twenty-five 
percent of the teachers at the pilot schools had received 

l£ainiii| and halfti 

Impact . AT has had an imt)act on training and on the school 
system, schools, educators and students involved. In the area 
of training. 62% of the teachers reported that they understood 
the model, and 81% felt that their teaching ability had 
improved as a result of their involvement with AT. 

The schoo l system benefitted from the improved communication, 
sharing, and cooperation among educators across the district. 
AT impact on the schools included greater continuity/consist- 
,ency within those subject areas and. teachers using AT, 
creased awareness of school needs, adoption of a uniform 
homework policy, and grass-roots expansion into other subject 
areas. I 

^^^^^^^ office staff reported that AT involvement enabled them 
to gain experience in a new teaching technique, made them 



Level of effort (time and energy) was rated on a scale from O.(none) t 
5.00 (a great deal). / . 



better organized, and allowed them to become more Involved 
with students. School administrators felt that AT enabled 
them to learn about a new teaching technique and to become 
aware of an effective method of observatidn^^supervision. 

Educators indicated that AT has had an impakt^Jat" the "cls^ss- ' 
room level in terms of a structured, consistent ' format , a 
clear understanding of teacher expectations, better use of 
time, and the use of effective learning activities. 

Teachers increased their knowledge of the components of effec- 
tive teaching and improved their skills in a new teaching 
technique; in organization, structure, planning, and pacing; 
in the effective use of time; in assessing and addressing 
student needs; and in instruction in general. Teachers 
strengthened their belief in large group instruction. 

Increased student achievement was evidenced in .terms of 
increased mastery/ retention of facts and skills, increased 
problem-solving abilities, and in test scores. Results of 
teacher-made criterion-referenced tests indicated that a 
larger percentage of students in AT classes than in control 
classes made achievement gains between the first and second 
semesters. 



Affective student "impflcF i^aa f » iF" -t r, frnm n"f fmp rorcT^ ^ 
attitudes about their learning ability and about school in 
. general. Behavior was better/less disruptive. Questionnaire 
psults (for over 400 high school students) showed improvement 
in all areas addressed, with greatest increases relating to 
students perceptions of "learning more than usual," "finding - 
the^lessons easier-." and "finding the lessons better than 
usual. 

' • Participant Concerns. Educators expressed the following 

concerns about AT: not applicable for all subjects/classrooms; 
too structured and can inhibit a teacher's creativity; 
difficulty in coordinating effective activity design,' 
materials" development and classroom management; and personnel 
and resources not used (or available) to meet project needs. 

Suggested recommendations fell Jnto the categories of class- 
room implementation (i.e., allow situational adaptation), 
implementation/ preparation (i.e., provide training and 
assistance),, expansion (i.e., expand to other classes/sub- 
^ jects/ teachers/schools, try another model), and external 

assistance^d.e., keep local staff informed about research on 
teacher effectiveness., increase cooperation between MSDE and 
' central office to help teachers solve problems). 

Factors influencing relative success included: 1) energy and enthusiasm 

of teacher coordinators who were AT advocates and built up the project, 2) 

administrative support and perseverance in encouraging voluntary involvement 
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in other schools. 3) use of various sources of information on school and 
.classroom effectiveness to reinforce AT, especially among administrative 

follow-up. assistance by "buddy" partners. Educators may wish to review the 
relative effectiveness of AT by subject area and/or teacher in light of 
concerns expressed and fidelity reported. Also, if Expansion continues there 
will be continued^need for assistance and support to teachers (probably most 
related to appropriate coordination and development of activities, materials, 
and management strategies). Given results to date, investment for review and 
support would probably be well worthwhile. 

Wicomico County . Wicomico has been implementing AT for one year using a 
Ji«trl^wide_stra^egjr^ 
1983). educators "hoped" for improvement in student achievement in non-basic 
skills subjects and had "achieved" the objective of informing local educators 
about the model. The remaining seven objectives specified in Table 8 were 
"partly achieved." 

• Scope and Intensity . In June 1983. AT was being' implemented 
mathLaticr'"^ '^^''^^^^ 

• Fidelity . All tdachers consistently addressed all components 
except independent practice which was not addressed by 8% of 
the teachers. The largest number of teachers reported that 
pre-lesson development and controlled practice were ' the AT 
components having the greatest impact on students. 

• Educators spent an average of eight montlis involved in 
AT across the 1982-83 school year. Teachers reported spending 
an average of 24% of their school week on AT-reLted acjivi- 

u 16S • 

School administrators spent an average of three days on AT. 
They reported that AT took less time and energy to imple- ment 
in comparison to similar previous projects 
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• Roles and Responsibilities , School administrators spent the 
least time and energy on dissemination (.67)* and the most 
effort on supporting school Implementation (3.00). 

Most of the training was done by MSDE and central office staff 

altK6ugh~some~teach"ers"rece^ 

staff (school administrators and teachers) . Educators rated 
the Interactive support received from the flya role groups 
Involved In AT as average and above. Developers received the 
lowest and central office staff the highest ratings of 
support. (Staff of this LEA did not Interact with the devel- 
oper.) By the beginning of Junie 1983, Information had been 
received by all educators. Training and help had been 
received by all central office staff and school administrators 
and by 25% of the teachers In the county. 

• Impact . 'AT has had an Impact on training and on the system, 
schools, educators, and students Involved. In the area of 
training , the majority of the teachers reported that they « 
understood the model, and that their teaching ability had 
Impi^bved as a result of their Involvement with AT. 

At the system level, a decision was made to Increase allocated 
time from 45 minutes to 60 minutes a day for elementary mathe- 
m^"t±"C"S^crl-a*ss eB^r^(-Th±s-Tra:r-re commettded--by--some-tea cher s-as--— - 
well as administrators.) The Impact of AT on Individual 
schools Included greater continuity /consistency within those 
subject areas and tea.phers using AT and- teacher enthusiasm and 
sharing. 

School administrators reported that AT enabled them to become 
better organized and to share Ideas with teachers. This 
strengthened their conviction that traditional Instruction 
works. . . 

Educators Indicated that AT has had an Impact at the classroom 
level In .terms of better usage of 'time and emphasis on large 
group Instruction. 

Teachers Increased their knowledge of the coinporTents "ojE~^Te^ 
tlve teaching, and Improved their skills In a new teaching 
technique; In organization, structure, planning, and piaclng; 
In the effective use of time; In the components of effective 
teaching; In assessing and. addressing student needs; and In 
Instruction In general. They strengthened their belief that 
teachers must really teach every day, strengthenied thslr 
attitudes about the value of specific components of effective 
teaching, and became more self confident as a result of AT. 

Increased student achievement was evidenced In Increased 
mastery/retention of facts and skills, and Increased problem 
solving abilities Indicated by results of teacher-made teste. 



* Level of effort (time and energy) was rated on a scale from 0 (none) to 5.00 
(a great deal) . • ' 

^^ ' 1-27, ■ . 
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Students enjoyed using AT and their behavior was better/less 
disruptive. Students also improved their attitudes about 
their learning capabilities and responsibilities and about 
school in general. , 

'~«r Participant "TO^^ EducatWr expressed the following 

concerns about AT: time allocations too rigid; too struc- 
tured/inhibits a teacher's creativity. Coordinating effective 
activity design, materials development, and classroom manage- 
ment was found to be difficult and personnel and resources 
were not being used. (or available) to meet project needs. 

Recommendations fell into the categories of classroom 
implementation (i.e., maintain and monitor fidelity, allow 
sufficient time for components, and have ability grouping), 
implementation/preparation (i.e., implement for the full year, 
reduce paper work, and provide training and assistance), and 
expansion (i.e., expand to other classes/subjects/teachers/ 
schools) . ■ „ 

Factors influencing relative success included: 1) strong central office 
support with active involvement of all elementary supervisors, and appropriate 
=-tWlnisrg-Wd^Wis-tanW^rovid 
2) informed support by principals, 3) professionalism and enthusiasm of 
teachers, and 4) opportunity and willingness to learn from "veteran" LEAs. 
Educators may want to address concerns relating to use of time (for specific 
components), to coordination and development of activities, materials, and 
effective management strate^s7~and~to explore ways" to maintain interest and 
energy. (Given the high degree of fidelity and competence of some of the AT 
te&hers, those issues might well be addressed in teacher-led problem-solving 
sessions.) Wicomico is making very good progress, and appears to be applying 
appropriate strategies of planned change to facilitate AT implementation. 
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Mastery Learning (ML) 

As stated In Chapter II, Mastery Learning (ML) Is an Instructional model 
which combines curriculum alignment (of sequenced- skills, systematic Instruc- \ 
tlon, and tests using Items addressing both lower order and higher order 
thinking skills) with a philosophy that all students, can achieve, A critical 
characteristic Is formatlvej "no fault" testing followed by appropriate 
corrective or enrichment activities. Final summatlve tests for each unit are 
glv^n, and student mastery of specified objectives Is recorded. Usually a 
school establishes a standard of at least 80% of students achieving mastery of 
at least 80% of a unit's objectives, ML Is most often used for structured 
academic subjects, 

During 1981-82, six LEAs (Allegany, Anne Arundel, Baltimore City, 



Baltimoxe^^County, Howard, and Worcester) implemented ML, In 1982-83, one 
additional coun^y^CQarroJl) became involved in ML. This section describes 
the implementation of ML including? planning; scope and intensity of imple- 
mentation; time spent on implementlng^ML; roles and responsibilities of ML 
implementers; ML impact on school systems, individual schools, educators, and 
students; and participant concerns. First, results across sites are 
discussed. Then, county profiles are presented, ^ 
Planning . - 

The extent of involvement of ML implementers In MSDE-organized planning 

» o 

■ c 

activities during the 1981-82 school year is summarized below: 

Overall, all LEAs involved cross-hierarchical teams In at 
least, ,, two planning activities,,,. School administrators 
were more heavily involved in planning than central office 
staff and teachers. Central office staff were more heavily 
involved- in planning than were teachers,,,, (Roberts et al, , 

1982) : 



129 



ERIC 



For the 1982-83 school year. MSDE did not organize any group planning 
activities but provided individual assistance in preparing 5'EPPS proposals to 
the "new" LEAs. None oi^ the veteran ML LEAs changed their original plans. 
/ An analysis of local plans for the 1982-83 school year identified LEA 
objectives and the status of each at the beginning of September 1982.* Table 
18 presents the objectives. In each case, the percent of LEAs that "hoped 
for." "partly achieved." or " a l r eady , achie ved" ea ch objecti ve is indicated. 



As can be seen in Table 18. there were nine objectives identified. All 
nine were addressed. by at least five of thp six "veteran" LEAs. Improving 
student achievement in basic skills; insuring a match between instruction, 
curriculum, and tests; helping teachers become better organized; and improving 
students' involvement in learning were objectives already achieved by some of 
_t4e-4^s.ft8^f.-SeptembeT-1982-. -The remaini^^^^ ; e ob j ectives were either 
"hoped for" or "partly achieved" by the LEAs addressing those objectives. 
Scope and Intensity of Implementation V 

In September 1982. seven LEAs were involved in ML but Carroll was just 
beginning its involvement. Allegany. Anne Arundel. Baltimore City. Baltimore' 
County. Howard, and Worcester were in their second year- of implementation. As 
can be seen in Table 19. in June 1982 scope and intensity varied among the six 
"veteran" LEAs from three mathematics teachers and approximately 80 students 
in one elementary school in one LEA to 40^ teachers in one high school teaching 
a variety of subject areas in another LEA. Across the six LEAs. approximately 
,6 schools and 78 teachers in a variety of subject areas were'involved in ML. 
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Table 18, 

Status of Local Objectives, 1982-83: Mastery Learning 



Local Objectives 



1. Improve student achievement 
(basic skills) . 

2. Improve student achievement 
(^theTsubjectsK 

3. Inform local educators about model. 

4. Train educators to use D^el. 



5. Improve teachers' classroom 
competence. 

■0 

6. Ensure match pf instruction, 
curriculum, and test(s). 

7. Help teachers become better 
organized. 

8. Improve time*on-task. 

9. Improve students' involvement in 
learning (motivation). 



*1 * Hoped for 
• ^ 2 « Partly achieved 
ERIC 3 -Achieved 



Status 



Pre-(Sept. 1982) 



1 
6 

5 
6 

.. 6 

6 

6 
6 

5 



Percent of LEAs 



i* 

0 

60 
83 
33 

33 

33 

33 
33 

20 



2* 



67 

40 
17 
67 

67 

50 

50 
67 

60 



3* 

33 

0 
0 
0 

0 

17 

17 

, 0 

20 



Post-(June 1983) 




Percent of LEAs 


N_ 


1* 


2* 


_3* 




14 


43 


43 




67 


33 


0 


1 




9Q 


Ji 




0 


71 


29 




n 


71 
1 i 






0 


43 


57 




0 


71 


29, 




0 


71 


29 




0 


60 


40 



Note. Total number of LEAs equals 7. 



Table 19 

Scope and Intensity, June 1982: Mastery Learning 



LEA 


Strategy 


1 ofi 
Schouis 


Type 


#of . 
Teachers 


' lof 
Students 


Subject Areas 


Allegany 


LS 


1 


0 


25. 


300 


R/U, M, SS, 0 


Anne Arundel • 


LS 


1 


H 


3 


100 

■f 


Sc 


Baltimore City 




1 


h' 


• 40 ' 




R/LA, M, Sc» SS, 0 


Baltimore County 


LS 




' E 


3 


80 


M 


Carroll 




New District 


• ■ 




Howard 


LS 


1 




2 

, J 




R/LA, SS ' 


Worcester 


LS 


• ■ I 


E 


5 . 


100 


M 



Subject Areas; R/U»Reading, language arts 
M«MatheiiiatiC8 * 
. Sc'Jcience . 
SS«Social Studies 
0«Other 

Type; E«Elementary school 
J/M«Junior high/middle 
{ H*High school ,. 
0«Other. 



Strategy; LS'Lighthouse school 
.PD«Pilot district 
DW'Dietrict vide 
CB«Capacity building 
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Table 20 presents the scope and intensity of ML implementation in June 
1983. Across the seven LEAs, two implementation strategies were being used 
(lighthouse school = 6; pilot district = 1). Approximately 203 teachers in 
13 elementary and ^.econdary schools were implementing ML. The majority of 
LEAs were using ... in mathematics. However, several LEAs were also using ML 
in reading/language arts, science, and social studies. Two LEAs tried ML in 
other subject areas in addition to the four areas mentioned above. 

. The percentage of schools in each LEA implementing ML as If June 1983 
^ran^ed from nearly 1% in Anne Arundel County to 8% in Worcester County. 
Acro^the entire state, 1% of the schools were involved in ML at the end of 
the 1982-83 school year. 

Some changes occurred between June 1982 and June\l983, the most obvious 
being in the one "new" LEA. Carroll decided to use a lighthouse school 
approach in one junior" high/middle school with two teachers in social studies, 

In general, the scope and intensity of implementation in the six 
"veteran" LEAs increased between June 1982 and June 1983. None of the six 
districts changed their implementation strategies. Two LEAs increased in 
number of schools. There were increases in the number of teachers imple- 
menting the model in three LEAs, and slight decreases in two LEAs. Number 
of students involved increased in four LEAs and decreased in one LEA. 
Subject areas were increased in two LEAs. 

Scope and intensity also includes fidelity — the extent to which 
teachers implement the model as designed. ML, as designed, requires the - 
implementation of 10 components or processes which are listed below: 

1. Objectives are specified. 

2. Objectives are broken down into component skills. 

3. Curricula are matched to objectives. ' " 

4. Instruction giv^h matches curricula and objectives'. 

5. Tests match objectives. 

' . 133 146 



Table 20 ' 

■Scope and Intensity, Ju,e 1983: Master, learning 




aatoii R/Meadlng, lang^ge arts 
M'Matheoatlcs , 
Sc'Science 

SS^Social Studies 
,P«Other 

"IZEi! Mlementary school 
' J/M=Junior high/middle 
H«Hlgh school 
OsOther t ' 



Strategj^: LS=Lighthouse school' 
PD=Pilot district 
- DMistrict wide 
CB^Capacity building 
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6. Tests include both higher and lower order thinking skills. 
^\ ^ no-fault formative test is given for each unit. 

8. Corrective and enrichment activities are given, after the formative 
test. 

9. Summative tests are given after each unit. 

10. Records are kept per class/student/objective on level of mastery. 

Of the 48 teachers responding to the General Survey, 23% carried out all 
10 processes. No process was addressed by less than 52% of the teachers. 
Processes most consistently addressed were: corrective and enrichment activi- 
ties and summative tests (each by 98% of the teachers), and matching tests to 
objectives (by 96% of the teachers). The process least addressed by teachers 
was record-keeping (52%) . The remaining six component components were 
addressed by at least 73% of the teachers. The greatest fidelity yas main- 
tained in Anne Arundel and Carroll counties (both small in scope and intensity 
of implementation, each with one school, and each with less than four teachers 
in one subject area). Greatest adaptation occurred in Allegany 'county (where 
there was a great range of subject areas and ^grades) . Baltimore City, which 
had the greatest scope -ind intensity of implementation, had a high level of 
fidelity. In general, fidelity across all of the LEAs was high. Teachers - 
indicated that the most important components of ML (in terms of instructional 
value) were the formative and summative tests that provided students a second 
chance to gain mastery.. The largest number of teachers defined mastery as 80% 
of the students achieving 80% or better on summative tests. Tl^s is in 
keeping with the developer's recommendation. 

Time Spent on the Model* ^ , 

This section discusses time spent on ML during the 1982-83 school yeaA 
Time across the school year is discussed first, followed by a discussion of 
the time spent by teachers and by school and central of f ice administrators. ' 

."— — — ^ 

* This information is based on the responses ma'de b^ a sample of implementers 
who completed the General Survey, 
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Across_ ^e school y ear. Ml implementation across the 1981-82 school ' 
J^^ar is suimnarized below: 

t982'°"?h'^'' had started using in the classroom by February 
nil u ^^^^"'^J^^ity of respondents began implementation in 
October 1981. Some teachers from each county except Howard were 

end2 ^ I" """^ ''''' -jority Of respondents 

■ unt J"'Pl^"'^"tation in June. Teachers in Baltimore County and 
Worcester began using ML in the classroom in September and 

menwl "f"' - '^^'^'^"^ ^""^ Arundel'sStidJmple- 

menting in January ana ended in June. Howard County used ML in 

the classroom during February and March. Teachers from Alleeanv 

began implementing between October and February and teminatfd 

implementation anywhere between December and June. Stating and 

ending dates for Baltimore City implementation ranged Sm 

September to May. (Roberts et al. , 1982) . 

During the 1982-83 school year, implementers across the seven LEAs were 

involved in SITIP for an average of eight months, with all investing at least 

6 monthsj. Baltimore city had the lowest and Anne Arundel had the highest 

average number of months of involvement! 

In the classroom . Time spent bv teachers it ^i o ^ , 

^f^iii. oy ceacners the classroom implementing 

ML during the 1981-82 school year is summarized belo^: 

orrh^M^^^^^i'^""" 5^^^"' ""^^ "majority ,pf teachers used ML l00% 
of the time allocated for th« selected subject during the imcle- 

ZlTr^o'llllL '""^ i-plementaJion period Srie7f'r\m 

another. Teachers from Baltimore County and WorceatPr 
used ML to teach all units in the designated subject area for thi 
entire school year. Anne Arundel teachers used ^ to teac^all 
biology units between January and June. Teachers in AUegany " 

Trill T f '"^ ^"^'"8 ""^^ f ^-"'--ter and two units 

during the second semester. The Baltimore City goal was for each 
discipline to use ML^to teach at least three unifs by the end of 
the school year: in^general. teachers completed two unJts efcS 

he ?98r82""r r° ''''^'r^ ^ ^° '^'''^ °- unU during 

the. 1981-82 school year. (Roberts et al.. 1982) 

In 1982-83. the teachers responding to the General Survey (n=39) indi- 
cated that they spent an average of 31% of their school week on ML-related ■ 
activities. The primary activity for the majority of teachers was classroom 
implementation. However, most teachers also spent time on planning and/or 
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tralnliig. Elementary teachers using MT. in one or two subject areas spent an. 
average of 23% of their school week on ML. Secondary teachers using ML in 
their specific subject areas spent a larger percentage (37%) of their school 
week involved in ML. While each teacher spent apprpximately a third of his or 
her time on ML, only in four LEAs (Allegany, Anne Arundel, Baltimore County, 
and Worcester) did students in a given grade and subject' area have ML as the 
instructional method for a complete course. 

In general, local educators indicated that ML required teachers to spend 
more time preparing students (e.g., grouping, pre-testing) , and dfd not allow 
the teacher to cover curriculum in less time. However, school administrators 
were less sure about curriculum coverage than were the teachers and central 
office staff. These results were similar to how educators felt during the 
1981-82 school year. Teachers implementing ML iri 1981-82 felt that although 
less curriculum may have been covered, the curriculum that was covered was 
taught" more thoroughly and was retained by more students. 

School and central office administrators ,* Twenty-four school adminis- 
trators and central office staff across the seven LEAs spent an average of 23 
days on SITIP. The average number of days ranged from seven in Allegany and 
Carroll to 57 in Baltimore City. In general, central office staff spent more 
time on SITIP (33 days) than did school administrators (13 days). 

Twenty- five central office 'staff and school administrators reported 
spending ^about the same amount of time and energy on SITIP as they .had on 
similar previous projects. However, in Anne Arundel and Howard counties, the 
school administrators felt that they had spent "slightly more" to 



* Central office staff in Baltimore and Worcester counties were involved with 
two models. No data were available from school administrators in Carroll 
County. t3 
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"substantially more" time and energy on SITIP, while the central office 
staff in those counties felt that "substantially less" time and energy hkd 
l|een spent. Administrators inCarroll County reported spending the least 
amount of time and energy (2.00 on a scale from 1.00 "substantially less"'\to 
5.00 "substantially more") while administrators from Worcester reported I 
spending the most amount of time (3.75). 

R6 1 e s "an d R e sp o n s ib 11 it i e s " 

The SITIP design encourages involvement of a cross-hierarchical team, 
including: ^ 1) central office staff, e.g.. supervisors in instruction or 
coordinators of staff development; 2) school administrators, e.g., princi- 
pals, vice principals, or department oheads ; and 3) classroom teachers. This 
section describes the people Involved, what they did, and their relationship 
to each other from three perspectives usual assigned roles, activities 
undertaken and ' level of effort, and interactive support. 

Usual -roles. Teachers , school-based administrators , and centrar of f ice 
staff were involved in ML. Of the 15 central office staff responding to the 
.1983 General Survey, one was in staff development, four were in instruction, 
two were in research and evaluation, and two were in "other" areas. Six had 
multiple^^esponsibilities. Of the 12 school administrators responding to 
the survey, 9 were principals (2 elementary. 2 junior high/middle. 2 high 
school, 1 other, and 2 no' grade level indicated) and three were vice princi- 
pals (2 elementary and one junior high/middle). Most of the teachers 
implementing ML were at the secondary/ level. 

Activities arid level of effort. On the General Survey, six activity 
areas were identified and central office staff and ool administrators 
(N=26) were asked toVndicate level c^^ effort (time and energy) spent on each 

' ■ ' \ / 
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"(with. responses ranging from 0 "none" to 5 "a great deal") for ML. The ar 
of activity were: 1) administration (Including planning and budgeting); 
2) development of materials; 3) designing and/or conducting inservlce; 
4) supporting school Implementation (e.g., problem-solvlng, supplying 
materials, etc.); 5) dissemination; and 6) evaluation. (Mean ratings are. 
presented In Table 21.) . 



The level of effort spent by central office staff and school a^minist^^" 
tors on each activity area during the first year of Implementation (1981-82) 
is summarized below: 

Central office staff and school administrators spent similar 
levels of effort on all areas of activity except materials 
development (in which school administrators were more involved) 
and Inservlce (in which central office staff were more involved). 
Most effort was spent on support and least on materials 
development ... 

• For administration, if central office staff put in more 
effort, school administrators did less, spending more 
time on support to teachers, instead. 

• Materials development was relatively high for only one 
central office respondent (Baltimore County) ^ and 
two school administrators (Baltimore City and Worcester). 

• Inservlce took more time for central office staff. 

• With the exception of one person from each role (each in 
a different LEA) , all respondents invested energy in 
supporting school efforts. 

• Dissemination and evaluation tasks were dealt with similarly 
between role groups and across counties except that in one 
county (Howard) neither activity was done by central office • 
staff or school administrators. (Roberts et al., 1982) 

As can be seen in Table 21, during 1982-83, central office staff and 
school administrators combined spent the least amount of time on materials 
development (2.00), and the most amount of time on supporting school 
implementation (3.31). 

Individual LEA responses Indicate that there was some level of effort 
spent on each activity across all of the LEAs. LEA responses varied: 
administration was rated highest by two LEAs (Anne Arundel and Carroll); 
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Table 21 

Level of Effort: Mastery Learning 1982-83 




1;^^ School Administrators 

r: \V , ^ 154 

ERIC 



development of materials and designing/conducting inservice by none of the 
LEAs; supporting school' implementation by two LEAs (Anne Arundel and Baltimore 
City); dissemination by one LEA (Howard); and evaluation by three LEAs 
(Allegany, Baltimore County, and Worcester).. 

Interactive support. Teachers Implementing ML could receive training/ 
information from four sources: developers, MSDE, central office staff, and ' 
-—school-based staff (school administrators and teachers) . The maJo^itjT^f" 
teachers responding to the survey (N=46) received information and training 
from school administrators and teachers (54%). The percentages of teachers 
receiving information and training from developers, MSDE, central office ' ' 

o 

staff, and school administrators and teachers did not vary greatly (percent- 
ages ranged between 39% for central office staff and 54% for school adminis- 
trators and teachers) . 

In Allegany and Baltimore City, most teachers (63% and 92%, respectively) 
received inf ormation/ training from school-based staff. The majority of 
teachers in Baltimore (67%) and Carroll (100%) counties received 
information/ training from three sources-developers, MSDE, and central office 
staff. In Worcester Count/, 43%' of teachers received inf ormation/ training 
from all four sources. In Howard County, all of the teachers received their 
, training from MS^E (100%) and in Anne Arundel from developers and MSDE. 

Survey respondents were asked to rate the support received from teachers, 
principals, central office staff, MSDE, and developers (from 1.00 = very poor, 
to 5.00 = excellent). Ratings of interactive support from the 1^82 su^'ey are 
summarized below: 

;:;o^°i^^' """''^^ ""^''^ ^""^^ ^^^^^^^ administrators were 
generally more positive in their assessment, rating all erouDS 

iTlT'-'' "^^'^^-^ g;neral,'i:ss pos^Jive, 

rating Che groups between 3.00 and 4.00. Central office staff 
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gave the highest rating. of support to teachers; school adminis- 
trators gave their highest rating to central office staff; and 
teachers indicated that school administrators had provided the 
most support. (Roberts et al., 1982) '. 

As shovm in Table 22,. respondents of the 19G3 survey rated the inter- 
active support received from all five role groups as 3.00 (average) or above, 
indicating that each role group was perceived positively by other educators 
Involved in ML in terms of providing information, help, and general support. 
Developers received the lowest ratings (3.21). while teachers received the 
highest ratings (4. 11) . School administrators were generally more positive in 
their assessments (except for their ratings of school administrators, which 
were slightly lower than the i:atings of central office staff tfor school 
administrators). Teachers were, in general, least positive in their ratings. 

• In general, teachers received most of their information and training ^ 
from school administrators and teachers. Three LEAs used all four groups as 
trainers, two LEAs used three role groups, and two LEAs used two role groups. 
Developers and MSDE were used as trainers/sources of information by all seven 
LEAs. The quality of support received was average or above .average for all 
role groups across all of tlie LEAs. Developers received the lowest ratings 
and teachers received the.hiWst ratings. Teachers were least positive in 
their ratings of interactive support. 
Impact <^ 

This section discusses ML impact in the area of training and on school 
systems, individual schools, central office staff, sc/ool administrators, 
teachers, and students. 

. Training. MSDE TAs held one two-day follow-.. ,|,ing session in the 
f.M of 1982 at Harper's Ferry. West Virginia for those^LE^s implementing 
ML. Presentations were designed to address conmion needs specified by the 
participants In a needs assessment survey sent out prior to the follow-up 

Si 
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Table 22 



Perceptions of Support Received: Hastery Learning, 1983-83 



Respondents 



Central Office Staff 

School Administrators 
Teachers 

Total 



u 



13 



/ 



48 



75 



Teachers 



I School 
Administrators 



Siport Groups 



i21 



4.31 



4.02 



4.11 



4.29 



4.25 



3.77 



3.95 



Central 
Office Staff 



4.29 



4.38 



3.52 



3.81 



3.93 



4.31 



3.37 



3.64 



Developers 



3.00 



3.69 



3.13 



3.21 



Hean ratings range froi a Iw of 1.00 (very poor) to a high of 5.00 (excellent). 



Whole group and small group presentations were conducted by MSDE TAs, by LEAs 
having expertise in a certain need area, and by external consultants. Topics 

o 

of presentations included: initiating ML (planning and Implementation), 
designing and* managing corrective and enrichment activities, analyzing prereq- 
uisite arid component skills, disseminating ML to new schools, training staff, 
and program evaluation. Approximately 42 ML participants were present, with 
six LEAs sending cross-hierarchical teams. One LEA participated only by 
having two administrators make a brief presentation. It was understood that 
participants were to acquire knowledge or skill to apply directly and also to 
transfer to others (by "turnkey" training). 

ML participant evaluations of the session conducted by MSDE were positive 
(e.g., clarity, relevancy, and accomplishment of objectives; support from 
MSDE). The mean responses ranged from 4.05 to 4.49 (1.00 being the least 
positive and 5.00 being the most positive). The maj.oi^jty of the ML partici-' 
pants considered the local group sharing (formal sessions and informal 
conversations) as the best part of the follow-up. Participants also liked the 
sessions on testing (test construction and testing what is taught) and staff 
development. * 

As indicated in the section on interactive support, the majority of 
implementing teachers received their training from school administrators and 
teachers. Most teachers felt that they understood the model (73%) and that 
their teaching ability had improved as a result of their involvement with ML 
(64%). Only 16% of the respondents felt that their teaching ability had not 
changed. In general, this pattern of results was fairly consistent across the 
seven LEAs, In four LEAs (Anne Arundel, Baltimore County, Carroll, and 
Howard), J.00% of the teachers felt they understood the mtiMl . However, at. 
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least 50% of the teachers in three of the LEAs (Anne Arundel, Carroll, and 
Howard) felt that they needed to learn more about actually implementing the 
model. Allegany and Worcester had the lowest percentage of teachers (60% and 
57%', respectively> indicating that they understood the model. With the excep- 
tion of Allegany, at least 50% of the teachers in. the other six LEAs felt that, 
their teaching ability had improved (100% of the teachers in Atine Arundel, 
Baltimore County, Carroll, and Worcester). A fairly high level of fidelity of 
implementation was maintained; a noteworthy accomplishment with a model as 
complex as ML. This faithful use of the model and the teachers' knowledge, 
skills and attitudes can be related to the effectiveness of the training 
received by the implementers, all of which link in some way back to MSDE 
initiatives. 

School system . The impact of an innovation on a school system involves 
changes in practice or policy by a groiip or organizational unit that affect or 
could affect more than a single school or single group of educators. Systemic 
impact included: 

• knowledge of planned change factors necessary to implement a new 
program (1 LEA) and of the research on effective teaching 

(1 LEA) 

• development of a training model for inservice credit (1 LEA) 

• commitment, cooperation, and sharing among educators (4 LEAs) 

o 

• policy decisions such as releasing teachers to coordinate the 
program and/or to provide training and coaching (2 LEAs) and 
decisions to base grading on mastery (1 LEA). 

These results suggest that educators were impressed by the processes of 

planned cftange and found the teaming concept to be effective. They were also 

influenced by the perceived instructional value of ML. 

■ IBS 



Central office staff , ML Impacted on Individual central office staff In 
a variety of ways. Central office. staff felt that SITIP Involvement provided 
them 'with knowledge of new, teaching strategies (3 LEAs) , understanding of 

c 

one's role In a project (1 LEA),, the opportunity to work as a team member with 
local and state educators In order to Improve student achievement and 
attitudes (1 LEA), an Improved understanding of the learning process and the 
Importance of reteachlng (2 LEAs) , an awareness of the necessity to be 
constantly aware of student needs (1 LEA), and the opportunity to share Ideas 
with other educators (1 LEA). These results reflect Individual supervisor's 
perceptions and attend almost equally to ML and to the processe-s of planned 
change advocated by SITIP TAs. These outcomes suggest that central office 
staff gained knowledge and developed positive attitudes about the program, but 
did not necessarily develop new skills or practices. 

Schools . The Impact of an Innovation on a single school Involved only 
those educators within that school.' ML Impact on single schools' Included: 

• better long range planning (1 LEA) 

• arrangement of schedules so that teachers can work together to 
develop correctives and extensions and have common planning time 
(2 LEAs) 

? " \ 

• a set of simplified, sequenced objectives (1 LEA), the development 
^ of a cross-reference system to allow students to keep track of 

objectives. Instruction, and assessment, and the use of teacher's 
aides to correct tests and keep records (1 LEA) 

• support to teachers (e.g. , recognition, provision of materials/ 
equipment) (2 LEAs) 

• teacher sharing/enthusiasm with some grass-roots expansion to other 
subject areas and teachers (5 LEAs) 

• better knowledge of Inservlce training and of new Instructional 
techniques. (1 LEA), a concern for achievement (1 LEA), and Improved 
teaching and learning In general (1 LEA).. 
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These results were influenced primarily by groups of teachers within a 
particular school with opportunity to work together, frequently with support 
and leadership resulting from a partnership that included a principal and a 
department head or "lead" teacher. 

. School administrators . School administrators felt that their involve- 
ment in ML enabled them to learn about a new teaching strategy (5 LEAs) and to 
share ideas with peers (1 LEA); gave them greater appreciation of what 
teachers can do (2 LEAs) ; an improved understanding of the learning process 
and" better organizational skills (1 LEA); made them more aware of the 
necessity of planning (1 LEA); and resulted in Fetter cooperation with staff 
(1 LEA). 

These results reflect commitment to quality instruction, and apprecia- 
tion of opportunities to work with teachers. 

Classrooms and teachers . Impact on teachers fell into 13 categories 
under the three general areas of: (i) increased knowledge, (2) improved 
skills, and (3) strengthened attitudes/perceptions. (See Table 23.) In 
addition, survey respondents assessed relative instructional value and impact 
on teachers in six areas on a five-point Likert scale. (See Table 24.) 

Improved skills in a new teaching technique and in organization/planning 
were the teacher impact categories reported by all role groups across the 
largest number of LEAs. As can be seen in Table 24. survey respondents in 
general indicated that ML was a worthwhile, workable model, with mean 
responses ranging from 3.85 to 4.35 (on a scale from 1.00 least positive' to 
5.00 most positive). They also believed that teachers enjoyed ML and 
increased their knowledge and skills (mean responses ranged from 3.77 to 
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Table 23 



Impact on Teachers as Reported by Each Role Group: 
Mastery Learning, 1982-83 



Impact on Teachers 



As a result of ML teachers have: 
Increased knowled^ 

- of the curriculum/program. 

' - of the components of effective teaching, 

- of the learning process. 

Improved skills 

- In a new teaching technique. 

- in organization/planning. 

- in the effective use of time. 

♦ in the components of effective teaching 
(e.g., review, prerequisite skill devel- 
opment, diagnosis, instructional objec- 
tives, supplemental instruction). 

- in assessing and addressing student 
needs . . ' 

- in curriculum development. 

Strengthened attitudes/perceptions 

- of what students can accomplish. 

- of teachers' confidence and self-image. 

- about teaching (e.g., involvement, co- 
operation, sharing, satisfaction, recog- 
nition) . " 

- of the value of specific components of 
effective teaching. 



Role Groups 
(Reported in No. of LEAs;| 
N=7) 



CO 



5 
5 
1 
3 



2 
0 



3 
1 
3 



SA 



1 
1 
0 



4 
3 
1 
2 



2 
0 



7 
7 
2 
4 



0 
1 



2 
1 
5 



CO = Central Office; SA = School Administrators; T = Teachers 
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Table 24 • 

Instructional bpact as Perceive J by Suney Respondents: 



Mastery Learning, 1982-83 



Impact on 'instruction • 



Instructional Value 

Works in classroom. 
Is worth the work it takes. 
Is a worthwhile teaching approach. 




IPipact on Teachers 

Teachers enjoy it. 
Teachers have increased knowledge. 
Teachers have increased skills. 

I^ppact onJtllj PTv^g 

/Students enjoy it. 
Students are less disruptive, 
Students' achievement has increased. 
iJtudents are learning more. 
Students' general behavior is better. 

Time 



Teacher, spend more time preparing students, 
ieachers cover curriculum in less time. 




4.07 


4.15 


4.08 


3.40 


3.42 


3.02 


3.73 


3.83 


3.75 


3.93 


4.00 


3.50 


3.33 


3.25 


2.98 


3.87 


4.33 


3.98' 


2.53 


3.15 


2.33 



4.09 
3.16 
3.76 
3.67 
3.09 



4.01 
2.51 



4.08). However, these responses were not as high as the responses given to 
classroom impact. Teachers were consistently lower than the other role groups 
In their ratings of teacher impact and' instructional value. 

Students. Impact of ML on students fell into 17 categories under the 
three general areas of: (1) improved attitudes or awareness, (2) increased 
achievement, and (3) benefits from better instruction. (See Table 25.) In 
addition, survey respondents assessed relative impact on students in five 
areas on a five-point Likert scale. (See Table 24.) Also. LEAs were asked to 
submit data summaries of cognitive and affective measures assessing Ml' impact 
in terms of student achievement and attitudes. The results of these measures 
are also summarized in this section. 

improved attitudes about their learning ability (e.g.. increased 
confidence, success, higher expectat.i^ons) was the most popular category of 
student impact reported across all three role groups. ' 

"^^^^^^^^ across the largest numbers of LEAs reported tliree main student 
impact categories: (1) increased achievement ,ln test scores, (2) improved 
attitudes about their learning ability, and (3) benefits from better 
instruction which provided a structured, consistent lesson format with 
specified objectives. 

Improved attitudes about their learning ability was the one student 
impact category reported by school administrators across the largest number 
of LEAs. o 

Central office staff found that students increased achievement in test 
scores and improved attitudes about their learning ability. 
.. As can be seen in Table 24. survey respondents in general felt that ML 
had somewhat of an impact on students in terms of better altitudes anJ 
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Table 25 



Impact on Students as Reported by Each Role Group: 
Mastery Learning 1982-83 





Role Groups 
(Reported in No. of LEAs; 
N=7X. 


Impaction Students 


CO 


SA 


T 


As a result of ML students have: 








Improved attitudes or awareness 








- about their learning ability (e.g.. In- 
creased confidence, higher expectations, 
of success) . 

- about their learning responsibilities 
(e.g., accountability).. 

- about learning/school (e.g.. Increased 
interest, cooperation, involvement, 
enthusiasm, motivation). 

- of areas of strength and weakness, 
about tests. 


4 
1 

3' 
0 

•c 0 


4 
0 

2 
1 

0 , 


4 
1 

3 
3 

2 


Increased achievement 








- in mastery/retention of facts • 
and skills. 

*- in ^problem-solving ^abilities & 
conceptual understanding. 

- especially lower achievers, 

- in grades. . ♦ 

- in test scores. 

- in general. 


1 

1 
0 
5 
0 


0 
0 

1 
1 

2 
0 


■ 3 

1 
1 
0 
5 
1 


Benefited from better instruction which 
provides 








- a structured, consistent lesson format . 
with specified "objectives. 

- a clear understanding of teacher .expec- 
tations. 

- less presstjre. 

- fewer gaps In skill development. 

-? a second chance to master — "no fault" 
test. 

- opportunities to releam — correctives 
and extensions. 


0 


0 

1 

1- 
1 

0 

0 


4 
2 
1 
2 

, 1 



=Cent.rai Office; SA=School Administrators; .T=Teachers 
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achievement, with mean responses ranging from 3.09 to 4.09 on a scale from 
1.00 (strongly disagree) to 5.00 (strongly Agree). Educators felt that ^ 
students enjoyed ML (4.09) and that they were learning and achieving more 
(3.67 and 3.76, respectively)., but were less sure whether student behavior was 
better/less disruptive (3.09 and 3.16, respectively). Teachers tended to be 
lower in their ratings of student impact than were central office staff and 
school administrators, except in their ratings of enjoyment and achievement 
which were slightly higher than the ratings given by central office staff. In 

general, respondents rated classroom impact higher than student impact, 

\ ■ ■ 
suggesting that overall instruction improved but direct impact on individual 

• \ 

students was less readily seen. 

, \ ' • - ■ • ■ 

Affective measures of. student impact were submitted by five of the seven 
LEAs.* Allegany and Carroll counties "gave their students the Student Ques- 
tionnaire before ^^L implementation (pre) and at the end of the implementation 
period (post).** The questionnaire . consists of seven questions or dimensions 
(^.g., recognition of differences, understanding of lesson, enjoyment of 
lesson, ease of lesson, learning of lesson, better grades , better lessons). 
Respondents answered using a five-point scale ranging from 1.00 (not at all) 
to 5,00 (yes a lot). There, are elementary and secondary versions of the 
questionnaire. ' \ 

In AlXegany County, the questionnaire was given to students in grades 4 
through 12. In Carroll County the questionnaire was administered to sixth 
graders .using the ML model in their social studies classes. As can' be seen 



in Table 26, mean responses averaged across the two LEAs ranged from 3.32 to 

* Baltimore and Howard counties did' not provide affective data. 

** Carroll County al^o^adiclra-gf^^ midway through the 

implementation t/eripd, but these data are not reported. ] 
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Table 26 



Stuaent Attitudes (Student (Juestionnaire) : Hastery Learning, 1982-83 



LEAs , 

Ik 


Alli 


-gany 


Carroll 


Total 


III mono 4 f\r\f3 


X - Pre 
N= 


X - Post 
N= 


X " rie 

N<55 


X - irost 
N=148 


X - Pre* 
N=2 


t - Post* 

y 5 

'N=2 


1. Recognition of differences 


3.47 


3.29 




H.jJ 


3.74 


• 

3.91 


2. Understanding 'of lesson 


4.25 


4.19 


A Jin 


/, CI 

4.04 


4.52 


4.41 


3. Enjoyment of lesson 


4.01 


4.09 


4ii7 




4,10 


4.21 


4. Ease of lesson 


3.48 


3.53 


3.17 


3.97 


3.32 


3.75 


5. Learning of lesson 


3.76 


3.67 


4.03 


3.97 


3.89 


3.82 


y* iJcLier giaues 


f\ /A 

3.60 


3.71 


3.32 


3.78 


, 3.46 


3.74 


7. ■ Better lessons 


3.72 


3.81 


3.97 


3.98' 


3.84 , 


3.89' 



* N equals number of LEAs, 



Mean responses range froi 1.00 (not at all), to 5.00 (yes a lot)'; . The higher the score, the higher the 
agreement with the dimension leasureii. mgner tne 
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4.52 on the pre and 3.74 to 4.41 on the post test. Comparing the pre and pos 
mean responses for the total group on each question, the responses increased 
(became more positive) on the post test for five ,of the seven dimensions: 
recognition of differences between previous lessons and the lessons where ML 
was used; enjoyment of the lesson; ease of the lesson; better grades; and an 
overall better lesson. On two dimensions the mean responses decreased on the 
post test: understanding of the lesson and learning more from the lesson. - 

These results were fairly consistent within the two individual LEAs 
except for Allegany whose mean responses also decreased from pre to post test 
on recognition of differences. Students in Carroll County tended to be 
slightly more positive in their responses than the students in Allegany 
County. 

Anne Arundel County and Baltimore Hity gave their secondary students 
the Learning Environment Inventory (LEI) at the end of the implementation 
period (post). The LEI contains 105 items measuring 15 dimensions. Eight 
dimensions were relevant for assessing }[L impact on student attitudes. Each 
is defined below: 

• Competitiveness— Students compete to see who can do the best work. 

• Satisfaction—Students enjoy their class work. 

• Difficulty—The work of the class is difficult. 

• Friction— There are tensions among certain groups of students that 
tend to interfere with class activities. 

■a 

• Dlsorganlzatlon-->The class is disorganized, 

• Apathy— Failure of the class would mean little to individual 
members. 

• Favoritism— Certain, students are favored more than the rest. 

• Environment- The. books and equipment students need or want are 
easily available to them in the classroom. 
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students answered the items using a four-point scale .ranging from 1.00 
(strongly disagree) to 4.00 (strongly agree). The higher, the score the 
higher the agreement with the dimension being measured. High agreement is 
desirable for satisfaction and environment; for all other dimensions except 
competitiveness low scores are desirable. Competition may or may not be 
considered desirable depending on the philosophy of the-«chool. Both LE. 3 
decided to measure all eight dimensions relevant to ML. As can be seen in 
Table 27, mean responses averaged across the two LEAs ranged from 2.19 
(favoritism) to 2.70 (friction). In Anne Arundel County, tfie^mension with 
the highest agreement (2.82) was environment, and the lowest agreement (2.07) 
was favoritism. In Baltimore City , competitiveness received the higliest score 
of 2.76, and difficulty the lowest score of 2.07. 

On satisfaction and environment, where high agreement is desirable, the 
total LEA responses were higher than the test norms. On the remaining 
dimensions (except competitiveness) where lower scores are desirable, total 
LEA responses were lower than test norms on difficulty and apathy a 1 the same 
on disorganizaMo . However, combined LEA scores were higher than the norms 
on friction and favoritism (especially Baltimore City). These results suggest 
that most classes have above average learning environment on several 
dimensions, but there is room for improvement in dealing with disorganization, 
friction, and favoritism. ' 

Worcester County gave its elementary students the My Class Inventory (MC) 
at the end of the implementation period (post). Instead of a pre test, the 
four teachers implementing ML indicated how they" predicted their students 
would respond. The My Class Inventory is an elementary version Lhe LEI 
with 45 items mo isuring five out of the 15 dimensions on the LEI. Four 
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Table 27 



S^^^^^t Attitudes (ton^jn^^ ^j^y^ ,^3^^^^ ^^^^^^^^ 



1982-83 ■ 



Affective Measures 




Units Measured 



Dimensions** 



1. 


Competitiveness 


2.43 


2. 


Satisfaction 


2.40 


3. 


Difficulty 


2.67 


4. 


Friction 


2.40 


5, 


Disorganization 


2.35 


6. 


Apatiiy 


. 2.54 


7. 


Favoritism 


2.03 


8. 


Environment 


2.40 



Learning Environ ment Inventory - LEI (S.econdary) 



National 
(Test Norms) 



Anne Arundel 



X - Post 
N=79 



2.53 

2.36 

2.61 

2.67 

2.44'- 

2.48 

2.07 

2.82 



Baltimore City 



X - Post 
N=61 



^.76 
2.52 
2.07 
2.73 
2.26 
2.47 
2.32 
2.49 



Total 



X - Post 
N=2* 



2.64 
2.44 
2.34 
2.70 
2.35 
2.47 
2.19 
2.66 



My -Class Inventory - MC (Elementary) 



Worcester 



Pre-Teachers(N=4)^: 
Hes Ih 



Post-Students (N=69) 
Hes no 



75 


25 


68 


32 


89 


11 


68 


32 


14 


86 


38 


62 


44 


56 


56 


44 



* N equals number of LEAs.' 

" "^Z^^:^::^''' <^-«^^ ^«->- the .ore, .e M,er 

yes no. the higher the percent of "yes" answers, the higher the agree.Lt with the 



dimension meisured. 



Higher scor s are desirable for satisfaction and environment- for all other 
scores are desirable. Competitiveness ..v nr " f ^"^'^ dimensions expect competitiveness, 1 

school. o^Petltiveness may or i^y not be considered desirable depending upon the philosophy o t 
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dimensions were relevant for assessing ML impact on student attitudes (i.e., 

..acisfaction, difficulty, anu lictic. Responses are- "yes' 
and no" and the higher the percent of "yes" answers, the higher the agree- 
ment with the dimension being measured. Like the LEI, high agreement is 
desirable for satisfaction and low agreement for difficulty and friction. 
Desirable scores on competitiveness depend upon individual school philoso- 
phies. Worcester decided to measure all four dimensions relevant to ML. 

The teachers predicted a high level of agreement with competitiveness 
(e.g., students feel that ... "students compete to see who can do the best 
work") and satisfaction (e.g., students enjoy class). The teachers predicted 
a lower level of agreement with difficulty (e.g., students do not feel that 
classrSbnj work is too difficult) and were unsure about friction. The 
students' responses followed the same patterns, indicating that the students 
responded the way their teachers predicted. There are no national norms 
available for the MC. 

Cognitive measures of student impact were submitted by five of the seven 
While all LEAs agreed to collect and summarize student achievement 
data, each was free to determine the kind of measure used and the design. For 
instance, some LEAs used teacher made tests; others used norm referenced mea- 
sures. Some LEAs reported class means for final (post) tests of ML students; 
others compared ML students with those in "regular" (control) classes. Scores 
reported included mean test scores, percent of students achieving "mastery," 
and p. ide equivalents. In three cases, LEAs reported data for two years. ' 
Student achievement data were received from: Allegany, Anne Arundel, . 
Baltimore County, Carroll and Worcester. Each is reviewed briefly. 
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Allegany County reported pre and post mathemktics and reading grade 
equlv .lent scores on the California Achievement Test (CAT) for grades 3 
through 8 during 1^31-82 and for grades 3 through 9 during . d2-83. In all 
cases gains were made. Allegany County also reported the number of students 
achieving mastery on summative tests given across the various ML subject 
areas. In grades K through 6. 84.5% of the students were achieving mastery, 
as were 80.1% of the students in grades 7 through 12. 

Anne Arundel County used a teacher-made criterion-referenced test to 
assess student achievement in biology. Seventy-eight high school students 
(9-12th grades) who had been taught with the ^TL technique (experimental group) 
received a mean score of 91.97 on the 132 item test compared to a non-ML group 
(control) of 73 students whose mean score was 69.49 (a difference of 22.48 
points). 

. In Baltimore County. 159 third and 107 fourth grade students in the three 
elementary schools implementing ML (experimental) and 119 third and 127 fourth 
grade students in three^^omparable schools not using ML (control) were pre and 
post tested on the mathematics portion of the Me tropolitan Achievement T..r 
(see Table 28). Both percentiles and grade equivalent scores were reported. 
Both the ML and non-ML schools showed gains between the pre and post tests. 
The ML schools showed larger gains, especially in the third grade scores. In 
one experimental site, percentile scores increased from 28th to 56th for third 
grade and from 28th to 54th for fourth grade. One of the three elementary 
schools was involved in ML (grades three and four) during the 1981-82 school 
year. After their second year of exposure to ML. students scored in the 96th 
percentile on the Metropolitan Achievement T.^t. Gains for that school 
exceeded normative predictions. 
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Table 28 



Metropolitan Achievement Test Scores for » 
Baltimore County: Mastery Learning,- 1982-83 



1 

f 




Grade 


. 

Group 


N 


National Percentiles 


National Grade Level 












Pre 


Post 


Gain 


Pt*p 

X 1. c 


Post 


[ Gain 
























1982-83 




3 


E 


159 


50 


76 




3.2 


5.0 


+ 1 .8 


(All schools) 






C 


119 


64 


74 


+ 10"^' 


3.6 


4.9 


+ 1.3 






4 


E 


107 


58 


82 


+24 


4.4 


6.6 


+2.2 








C 


127 


62 


84 


+22 


4.6 


6.7 


+2.1 


1981-82 




3-4 






60 


77 


+ 17 


3.4 


4.9 


+ 1.5 


(Pilot school 


only) 


4-5 






62 


82 


+20 


4.5 


6.7 


+2.2 


1982-83 




3-4 






68 


86 


+ 18 


4.8 


6.8 


+ 2 


(Pilot school 


only) 


4-5 






74 


96 


+22 


6.1 


9.0 


+2.9 



E=Experimental; C=Control 



The highest gains were made by ML schools with the lowest initial scores. 
Initially high scoring sites appear to benefit less (possible influenced by 
the "ceiling" effect). Overall, gains were greater for ML schools than for 
control sites. 

Carroll County reported the number of students achieving mastery on 
three summative tests given during the implementation of an ML unit in 
economics. Out of a total'of 160 sixth grade students involved in MT., 89%, 
80%, and 85% achieved mastery on the three tests. "Mastery" was defined as 
80% students achieving 80% correct answers. 

' In Worcester County, cognitive assessment was done using criterion- 
referenced and norm-referenced tests. Two types of criterion-referenced tests 
were used — unit summative tests and a comprehensive end of the year test. The 
overall objective of the ML project in Worcester County was 95^ mastery ^at the 
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85% level. In grades one and two for mathematics . this objective was met on 
all unit summative tests. The objective was achieved for three out of four 
unit summative tests in grade three. (Third graders only used ML for four 
units of instruction.) On the end of the year comprehensive test, 100% of the 
students achieved mastery with an average score of 98% in grade one. 97% of 
the students achieved mastery with an average score of 98% in grade one. 97% 
of the students in grade two achieved mastery with an average score of 96%. 
and 75% of the third graders who used ML for only four units achieved mastery 
with an average score of 89%. These results show that the students retained 
what they had been taught. Scores on the California Achievement Test (CAT) 
confirm the results obtained on the teacher-made tests. As can be seen in 
Table 29, the mean grade equivalent scores on the pre test given in October 
1982 and the post test given in May 1983 show increases that are larger than 
normal. 

Table 29 

CAT Scores, (Mathematics) Worcester County: Mastery Learning, 1982-83 





Pre 


Post 


Growth 


Normal Growth 


Grade 1 
Grade 2 - 


1.1 
2.3 


2.3 
3.5 


1.2 
1.2 


, .8 
.8 



Not only are the mean grade equivalents high, but also the standard deviations 
are low in comparison to the standard deviations in previous years. These 
lower standard deviations indicate that students are scoring closer to the 
mean. As stated in the county report, "The standard deviation of 5.8 for the 
82-83 second grade is very significant with a high ferade equivalent mean of 
3.5." 
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Direct cause and effect" claims for ML Impact on student achievement 
cannot be made on the basis of the above data and test designs used. However, 
for the four LEAs providing cognitive data, large percentages of students have 
mastered material, and student scores on achievement tests has shown growth 
which can be attributed, at least In part, to JJL, 
Participant Concerns 

Chart 4 lists the concerns reported by ML Implementers.^ these concerns 
were divided Into two general areas: concerns specific to the ML model and 
concerns related to the process of Implementation, 

Most of the concerns were model-specific. They fell Into three catego-- 
rles: concerns related to specific components of the model, time concerns, 
and concerns related to the educational value of ML. The largest number of 
LEAs reported time concerns. ^ 

Concerns related to the process of Implementation were directed at school 
(insufficient preparation time), district (inflexible LEA budget process), and 
state (unclear evaluation guidelines f 1:0m MSDE) levels. 

Chart 5 lists the recommendations /solutions reported by ML implementers. 
These recommendations were divided into five general areas: classroom imple-- 
mentation, implementation/preparation, involvement, expansion, and external 
assistance. The largest number of LEAs made, recommendations in the area of 
implementation/preparation (especially increasing preparation time) and in the 
area of expansion (especially increasing the numbers of teachers, schools, 
students, and subject areas). 

Very few of the recommendations were solutions for the concerns stated. 
The majority of the concerns expressed were model specific; howler, the 
majority of the recommendations or solutions were process oriented. Six out 

c 
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Chart 4 

erns/Problems Reported: Mastery Learning, 1982-83* 



The model—ML . . . 

Is difficult to use wi€h some subjects/topics (2) 

^s d^mcuit II correctives/extensions (1) =. 

is difficult to ffhd appropriate enrichment activities (2) 

Requires too much time/effort on record-keeping - (1) 
Requires too much time for student testing (1) 
Requires too much time in general (7) 
Reduces curriculum coverage (1) 

Holds back academically talented students (5) 
The process of implementation 

Insufficient time for preparation (of lessons) <2) 

Inflexible LEA budget process (1) 

Unclear evaluation guidelines from MSDE (1) 

* stl^ement'? ^"""'""'^ indicate the number of ,LEAs making a given 
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Chart 5 

Recommendations/Solutions : Mastery Learning M982-83 



Classroom Implementatlo'ti 

r ' 

Develop/use computerized record-keeplnjg system or provide more clerical 
help (1) . 
Have smaller classes (1) 

Impleinentatlon/preparatlon 
Increase preparation time (5) 

Increase number of teachers Involved in curriculum/ unit development (2) 
Sequence- units more carefully (1) > 

Involvement . 

Encourage, teachers to increase knowledgj^ and skills (e.g., release time for 
professional growth) (3) - ' 

Have only voluntary participation (2) 

Compensate teachers for after school trv. a Ing/planning (2) 

o . 

Expansion 

Increase numbers of teachers, students, schools, subject areas (6) 
Before expansion, measure imp&ct on student achievement (2) 

External assistance • o " 

MSDE should -provide: funds for local training (1) 

more funds (1)* 

research updates on school improvement (1) 
more help (in general) (1) 
-encourage more inter-county networking (2) 



* Figures in parenthesis indicate the number of LEAs making a given statemevit. 



of the sevfen ML LEAs recommended expansion, even though some educators within 
those LEAs| expressed concerns about the model and its implementation. In 
general, teachers were more concerned about classroom application, and the 
time needed in relation to the relative impact on students, while adminis- 
trators advocated expansion. Findings suggest a careful .review of both 
objective (e.g.. test scores) and subjective (e.g.. teacher perceptions) 
value in order to determine next steps (e.g:. termination, in-school support 

■ f or -institutlonaiizationv- ^r- expan-sion- to other - sites) ; " ■ - 

Summary and Conclusions 

In the preceding pages, each research question, or issue has been 
.addressed and findings discussed across LEAs. Here, some general conclusions 
across issues and LEAs are reviewed. Then, findings are summarized for each 
LEA.* 

It is apparent that LEAs have invested considerable effort in MT,. and 
found that the instructional model had both objective and subjective value. 
The level of fidelity was high and, in most cases, standards of implementa- 
tion of specific components were good. The demands of ML required time and 
effort from teachers— particularly for development of units (including tests 
and corrective and enrichment activities) —and also required support from " 
administrators (e.g.. development of tim^^saving record-keeping systems, 
arrangements" for planning time). However, once the development work had been 
done, educators found ML useful, pair ticularly f or structured academic 
curricula. ' . ' " ■ 



Levels of information vary, in part because three LEAs were pilot sites of 
which one invited RBS site visits, and in part because some LEAs provided 
more documentation or other evidence of model implementation. 
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Impact was made on student achievement when ML was used for a full course 
or year in a given subject. Students' attitudes about their own ability and 
responsibility to learn increased when ML is used consistently for a given 
subject. ' 

Impact was made on individual teachers' knowledge (access to a strategy 
of instruction) throu-^h training, and teachers' sense of efficacy increased 
when they used ML and saw students' benefitting from it. However, because 
" "initial "ihvolvemeririras'so^d 
(logistical and affective) if they were to use ML enough to make a real 
impact on students. 

Impact was made on a school. (the faculty and how instructional matters 
are dealt with) when the principal was" actively involved and when the use of 
ML was not perceived as a strategy used occassionally by a few teachers at 
their discretion, but rather as a model systematically used for a given 
subject and grade level. . 

Impact' was made outside the pilot school when central office staff saw 
the objective value (student achievement data), and when initial implementers 
provided assistance and training to faculty in other schools. 

The strategies used to provide interactive support (and maintain some 
on-going resources and interest') were crucial to the relative success of the 
project. Positive impact was made when teachers believed that their opinions 
counted and that their needs were seriously considered; when local evaluators 
(teachers and others) had enough knowledge and skill to develop units that 
teachers like ; when principals expected and acknowledged fidelity implemen- 
tation; vzhen coordinators provided training, coaching, materials, and 
relevant information/expertise (themselves or by accessing others, e.g.. 



"master" teachers) ; when central office staff provided resources for develop- 
ment work, clearly and consistently communicated the nature and extent of 
their interest in the success of ML. and facilitate shared decision-making and 
networking. Positive impact was reduced or barriers created when: there was 
heavy reliance on training alone, expecting teachers' professionalism and 
autonomy to motivate development and implementation; development efforts were 
broadly spread and resources (especially staff time) were rationed. Teachers 

were devalued, usually due to mandate or 
autocratic leadership; messages from (different) administrators to -teachers 
were conflicting or confusing (e.g., about the relative priority of the 
project, specific roles and responsibilities, or how a given task was to be 
done). (This last "barrier"~cominunication confusion-was made worse in some 
cases by MSDE TAs.) 

In the following case reports of the seven LEAs implementing ML, atten- 
tion is glv^n to the influential factors mentioned above and also to specific 
objectives and results achieved at each site. 

Allegany County . Allegany has been implementing ML for two years using a 
lighthouse school strategy, 'in September 1982, Allegany educators "hoped" to 
train educators to use ML and - had "partly achieved" the reiaining eight 
objectives specified in Table 18. In June 1983. all nine objectives had been 
"partly achieved." 

• Scope and Intensity. After the first year of ML implementa- 
tion (June. 1982), ML was being implemented in one school 
grades K-12 with approximately 25 teachers and 300 students in 
a variety of subject areas. Little changed in the 1982-83 
school year. 

• Fidelity . Allegany County educatots showed the greatest 
adaptation of the ML model (i.e., ^the smallest percentage of 
teachers implementing all 10 ML processes or components) in 
comparison to the other ML LEAs (probably because a greater 
range of subject areas and grades were included). The ML 
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components most consistently addressed by the Allegany 
teachers were corrective and enrichment activities and summa- 
tive tests; the components least addressed were the breakdown 
of objectives into component skills, and record-keeping. The 
largest number of teachers reported that the "no fault" forma- 
tive and summative testing and the correctives and extensions 
were the ML components- having the greatest impact on students. 

• ZilS®.* Educators spent an average of 8.5 months involved in ML 
across the 1982-83 school year. Teachers reported spending an 
average of 25% of their school week on ML-related activities. 
ML required teachers to spend more time preparing students 
(e.g., grouping, pre-testing) and allowed 'l6ss time for 
curriculum coverage. 

Scho,oL..administr„ajt;Qr.9^,.§.p^ent._an and 

combined average of both role groups (seven days) was one of 
the two lowest reported .5 School administrators and central 
office staff reported that ML took about the same amount of 
time and energy as had similar previous projects. 

• Roles and Responsibilit-ies . School administrators and central 
office staff combined spent the least amount of time and 
energy (level of effort) on developing materials (2.25)* and 
the most amount of energy on evaluation (5.75). School 
administrators spent the least amount of time on administra- 

-.tion, developing materials, and supporting school implementa- 
tion (3.00 for each area) and the most amount of time on 
designing/conducting inservices, dissemination, and evaluation 
(3.50 for each area). Central office staff spent the least 
amount of time on developing materials (1.50) and the most 
amount of time on evaluation (4.00). Allegany used'^the 
California Achievement Test , the Student Questionnaire, and 
surveys of student, teacher, and parent reactions to evaluate 
ML. 

Most of the training was done by school administrators and 
teachers, although some teachers received training/inf orraation 
from developers, MSDE, and central office staff, as well. 
Allegany educators rated the interactive supp'^ort received from 
these five role groups as" average or above. Developers 
received the lowest ratings and teachers the highest. By the 
beginning of June 1983, information related to ML had been 
received by all central office staff and school administrators 
and by 25% of the teachers and other faculty. Training and 
support had breen received by 25% of central office staff anrl 
- school administrators, and by none of the teachers and other 
faculty outside the pilot school. 



Level of effort (time and energy) was rated on a scale from 0 (none) to 
5.00 (a great deal). 
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Im£act. ML has had an impact on training and on the school 
system, the school, the educators, and the students involved. 
In the area of training . 60% of the teachers felt that they 
understood the model (Allegany was one of two LEAs with the 
lowest percentage of teachers indicating that they understood 
: the model). Forty percent of the teachers (the lowest percen- 
tage across the ML LEAs) , felt that their teaching ability had 
improved as a result of thair involvement with ML. 

As a result of its involvement in SITIP, the Allegany school 
system increased knowledge of the planned change factors 
necessary in order to implement a new program. The school- 
wide impact of ML has been in terms of better long range 
planning, teacher recognition, and teacher sharing, with some 
grassroots expansion to other classes. 

Central office staff felt that involvement in the SITIP 

?joject gave them the opportunity to work as team members witli 
ocal and state" educators in order to improve student 
achievement and attitudes, and made them more aware of the 
necessity to be constantly in touch with student needs. 

Allegany educators indicated that ML has had an impact at the 
classroom level (e.g., ML is a worthwhile, workable instruc- 
tional model) , but their ratings of classroom impact were lower 
than those of other ML LEAs. The , classroom impact of ML was 
related to the use of a structured lesson format with clearly 
specified objectives and the opportunity to relearn—correc- 
tives and extensions. 

Teachers increased their knowledge of the components of effec- 
tive teaching, of the curriculum/program being used in their 
school, and of the learning process in general. They improved 
their skills in a new teaching technique, in organization/ 
planning, in the components of effective teaching, and in . 
assessing and addressing student needs. Strengthened attitudes/ 
perceptions about teaching in general, about what students can 
accomplish, and of the value of specific components of effec- 
tive teaching were also seen as impacts on teachers. 

Increased student achievement was perceived by educators aiid 
evidenced in test„scores. Student impact in terms of- scores 
on the CAT showed gains for reading and mathematics. Educa- 
tors also reported that students increased their retention of 
facts and skills and their problem-solving abiliti^^s. 

Student attitudes became more positive.af ter ML implementation 
on four dimensions of the Student Questionnaire: enjoyment of 
lessons, ease of lessons, .better grades, and overall better 
lessons. Educators reported improved student attitudes or 
awareness about tests and about learning capability. 
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• Participant Concerns , Allegany educators expressed model- 
specific concerns (e.g., ML Is difficult to use with some 
subjects/topics; It Is difficult to group students for 
correctives/extensions; the model requires too much time In 
general; and ML holds back academically talented students). 
They also expressed concerns related to the process of Imple- 
mentation (e.g. , Insufficient time for preparation of 
lessons) . 

Chatiges/vecommendatlons suggested by Allegany Implementers 
fell Into the areas of classroom Implementation (e.g., have 
smaller classes). Implementation/preparation (e.g.. Increase 
preparation time). Involvement (e.g., have only voluntary 
participation), and external assistance (e.g., more funds for 
training and more/better help In general from MSDE) . 

Factors Influencing the relative success of ML In Allegany Included: (1) 
on-site assistance from MSDE by a delegate TA (outside the established TA 
team) , which built on an existing good LEA/MSDE relationship but which did not 
readily access network information and ML expertise; (2) reassignment of the 
school principal which then required time for communication/orientation; (3) 
implementation across* several subjects and grade levels, which Increased com- 
plexity and somewhat reduced fidelity; (4) strong central office support and 
application of SITIP processes in planning — particularly the formation of a 
cross-hierarchical steering committee ~ which helped build commitment, main-- 
tain en^rrgy, and probably Influenced the positive perceptions of implementers 
about their Involvement and about ML Impact on teachers and students. A point 

of in t e r ^kt^S s_lAa t-^t t^nJld.xm_K^ ommunltiy 

members, generating Interest in the school and in the;students' education. 
Although ML is not a major county priority, expansion is planned for the :^983'- 
84 school year, with ML to be Implemented by volunteer teachers in the voca- 
tional technical school. This expansion if encouraging since Allegaay used a 
lighthouse strategy. However, results Suggest that project activities within 
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each school may need to be consolidated — allocating time and effort where it 
is needed (e.g., for common planning time by a group of teachers), and 
relative fidelity may need to be reviewed and compared with student outcomes. 

Anne Arundel County. Anne Arundel has been implementing ML for two years 
using a lighthouse strategy. In September 1982, Anne Arundel educators had 
'partly achieved" three of the nine- objectives specified in Table 18 
[improving student achievement in basic skills, informing local educators 
a*)out the model, and tvaining educators to use the model). Educators "hoped" 
to\achieve the remaining six objectives. In June 1983, fout of the six "hoped 
for" objectives (improving teachers' classroom competence; ensuring a match of 
instruction, curriculum, and tests; helping teachers become better organized; 
and improving time-on-task) were "partly achieved." The status of the 
remaining five objectives did not change between September 1982 and June 1982 
(except for improving students' involvement in learning which was "hoped" for 
In September but was not given a status rating in June) . 

V 

• Scope and Intensity . After the first year of ML Implementar- 
tion (June 1982), ML was being Implemented In one high school 
with three teachers and 100 students In biology. The number 
of. students Involved Increased during the 1982-83 school year, 

o Fidelity. Anne Arundel was one of two LEAs malntalnln$: the 
greatest fiddellty to .the ML model: all. of the teachers 
addressed^^all 10 ML processes. The teachers reported thst the 

^'~~-fi'^^'faulH:"-^fiDmat-ive 



specified objectives were the MT. processes having the greatest 
Impact on students- 

Time. Educators spent an average of 10 months invol'^Ped in ML 

across the 1982-83 school year (the highest across the ML 

LEAs). Teachers reported spending an average of 40% of their 
school week on ^fl.-related activities'. ML required teachers to 
spend more time preparing students (e.g., grouping,- pre- ' 
testing), but educators reported. that teachers were able to 
cover the curriculum in a shorter amount of time using ML. 

The school administrators spent an average of 20 days, and 
central office staff an average of six days on ML. The school 
administrator reported that ML took "slightly more" time and 



energy than had similar previous projects while the central 
office staff person reported "substantially less" time and 
energy. 

• Roles and Responsibilities . Central office staff spent the 
least amount of time and energy (level of effort) on designing 
and/or conducting inservice and materials development (1.00 * 
for each area)* and the most amount of time and effort on 
administration and supporting school implementation (4.00 for 
each area) . The school aJ^inistrator spent the least amount 
of time on administration, supporting school implemen tation, 
and dissemination (3.00- for each area) and the most time on 
materials development (5.00). 

The training was done by developers and MSDE. Anne Arundel 
educators rated the interactive support received from the five 
role groups involved in SITIP as average or above except for 
developers. Teachers and MSDE received the highest ratings 
and developers the lowest ratings for support. By the end of 
the 1982-83 school year, central office interest and support 
had increased. One of the three teachers implementing ML was 
assigned as a biology resource teacher to provide assistance . 
to teachers district wide, thus giving him the opportunity to 
disseminate the MT. strategy. By the beginning of June 1983, 
information related, to ML had been received by 75% of central 
office staff and by all faculty and school administrators at 
the ML school site. Training had been received by 25% of ■ 
central office ^staff and by 25% of school administrators and 
other faculty at the ML school site. 

• Impact. ML has had an impact on training, and on the school, 
the educators, and the students involved. In the area of 
training, all of the teachers thought that they understood and 
knew a great deal about the model, but they also thought that 
they needed to learn more. 

The school>>wide impact of ML has been in terms of the arrange- 
ment of schedules so that teachers can, work together to plan 
and to implement ML; the development of a cross-reference 

^ysrem-to--allw'-shideflt^^-"r6^-Tce^ 
tion, and assessment; the use of teachers' aides for test 

■r -rection and record-keeping; the provision of support to., 
ttachers in the area of materials/ equipment; increases in 
teacher interest; and better knowledge of inservice training 
and of a new instructional technique. 

Central o ffice staff felt that involvement with ML provided 
them with an improved understanding of < the learning process. 
School ad ministrators felt that involvement with ML gave them 
a greater appreciation of . what teachers can do, an improved 



* Level of effort (time and energy) was rated on a scale from 0 (none) - 
5.00 (a great deal).. 
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understanding of the learning process, and better organiza- 
tional skills, and enabled them to learn. about a new teaching 
strategy and to share Ideas with teachers. 

Ratings of classroom level Impact (e.g., ML. Is a worthwhile, 
workable Instructional model) were positive (above 4.20) and 
were expressed In relation to clarity of teacher expectations, 
and the use of a structured lesson format with clearly speci- 
fied objectives. 

f , ' * 

Teachers increase^ their knowledge of the components of effec- 
tive teaching and of the learning process. They improved 
their skills in a new teaching technique, in organization/ 
planning, and in the effective use of time. Strengthened 
attitudes/perceptions of "teachers ' confidence and self image, 
of the value of specific components of effective teaching, of 
what students can accomplish, and about teaching in general 
were .also seen as impacts on teachers. 

Cognitive student impact was perceived by educators and 
evidenced In iiiproved grades. On a teacher-made criterion- 
referenced tes-:. students involved in ML had a higher average, 
number of correct answers than did similar students in 

regular" classes (a difference of 22.48 points on a 132 point 
test) . 

Affective student impact was positive in terms of improved 
attitudes about their learning responsibilities and about 
learning and school . in general. Behavior/discipline appeared 
to be somewhat improved. In comparison to national norms, ' 
students perceived higher levels of friction, and a more 
positive physical classroom environment in their ML classes, 
but in all other LEI dimensions there were relatively li-ttle 
differences .between ML scores and national norms. 

• • Participant Concerns. Anne Arundel educators expressed model- 
specific concerns (e.g., it is difficult' to find appropriate 
enrichment activities; the model requires too much time in 
general; and ML holds back academically talented students) . 
__..__..-Changes/recommendations reported by Anne Arundel implementers 
fell into the areas of expansion (e.g., increase numbers of 
teachers, schools, subject areas) and external assistance 
(e.g.,^more funds for local training from MSDE, and more 
encouragement from MSDE for inter-county networking) . 

Factors influencing the relative success of ML in Anne Arundel 
included: (1). the support and approval of the school principal; (?) the 
task-oriented leadership of the department head; (3) the dedication, 
creativity, and professionalism of the school-based team; (4) the proactive 
efforts of that team to inform and involve others; and (5) central office 
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agreement with school staff plans for resource allocations. Two factors of 
interest that may also have had a positive' influence were: 1) energy spent 
on careful development of test items to match objectives and cover the 
cognitive levels of thinking, and 2) course planning outlines distributed t 

students for their own diagnosis of success on given objectives. Given the 

.J* 

fact that a lighthouse strategy was used, Aune Arundel developed a good 
program. 'Expansion by voluntary involvement of biology teachers in- other 
schools may well be considered by local educators. 

Baltimore City . Baltimore City has been implementing ML for two years 
, using a pilot-district strategy . In September 1982, educators "hoped" to 
train teachers to use the model and to ensure a match between instruction^ 
curriculum, and tests, and had "partly achieved" the remaining seven 
objectives specified in Table 18. In June 1983, one objective, informing 
local educators about the model, had been "achieved." The two "hoped" for 
objectives had been "partly achieved," and the status of the remaining six 
objectives remained unchanged as "partly achieved." 

• Scope and Intensity . After the first year of implementation 
(June' 1982), ML was being implemented in one high school with ' 
approximately 40 teachers in a variety of subject areas. By 

June of 1983, four junior highs were using ML in addition to 
the pilot high school, ■ making a total of 5 schools, 150 
teachers, and 3,332 students. 

• Fidelity . Baltimore City educators implemented ML with a high 
degree of fidelity, especially considering the wide range of 
subject areas included. The four ML processes or components 

r most consistently addressed were matching tests to objectives, 
and giving no fault formative tests, correctives and exten- 
sions, and summative tests after each unit. The component 
least addressed was record-keeping.* The largest number of 
teachers reported that the "no fault" and summative testing 
were the ML components having the greatest impact on students. 



* A goal for. the project is computerised record-keeping. 

o . 
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Time. Educators spent an average of 6.5 toonths Involved in 
ML across the 1982-83 school year. Teachers reported spending 
an average of 42.5% of their school week on SITIP-related 
activities when using ML. Interested educators in 13 disci- 
plines wG.re asked to develop and implement two to five units 
using ML (each lasting two to five weeks).* ML required 
teachers to spend more time preparing students (e.g., 
grouping, pre-testing) and allowed slightly less time for 
curriculum coverage. School administrators spent an average 
of 19 days and central office staff an average of 50 days on 
ML activities. School administrators and central office staff, 
reported that ML took about the same amount of time and energy 
as ^ad similar previous projects. 

Roles and Responsibilities . Central office staff spent the 
most amount of time and energy (level of effort) on supporting 
school implementation (4.00) and dissemination** (4.00) on a 
scale from 0 (none), to 5.00 (a gre- t deal) and the least on 
materials aevelopment (2.67). School administrators spent the 
most effort on supporting school implementation (4.00) and the 
least on conducting inservice (1.67). 

Mo&t of the training was done by school administrators and 
teachers. (The coordinator of the ML project at the pilot 
high school does the majority of the training.) Some teachers 
also received training from developers, central office staff, 
and MSDE. Interactive support received from the five role 
groups involved in SHIP was perceived by educators as above 
average. School administrators received the highest ratings 
and developers the lowest. Teachers gave the lowest ratings 
to all five groups. By the beginning of June 1983, informa- 
tion had been received by all central office staff. At the 
pilot site, school administrators and 75% of the teachers and 
other faculty had received information. Also at the school 
site, training, had been received by about 50% of the teachers 
and 25% of othsr faculty. About 25% of the teachers, and about 
12,^ of other faculty, had received help .*** (Across the LEA, 
a great deal more training has been done to support . implemen- 
tation of ML. However, that is separate from SITIP.) 



* One unit from each discipline is being reviewed and approved by a coor- 
dinator at central office for use as a resource unit for staff development 
purposes; 

** The SITIP project is part of the district's five year plan to implement I-IL 
in all schools. School site staff have presented the project r/ the 
annual meeting of the American Educational Research Association and in the 
local media. The project is currently being considered for eligibility as 
a 'p-omising educational practice." , • ^ 

*** A ML workshop was designed and was approved by MSDE for Inservice credit 
i^ltty-three teachers have completed the workshop. 
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• Impact , ML has had an Impact on training and on the schoo"! 
system, the educators, and the students involved. In the area 
of training , 75% of the teachers reported understanding the 
model and 17% felt they needed to learn more about the model. 

System-wide impact of ML has been in terms of the develop- 
ment of a training model for inservice credit; commitment, 
cooperation, and sharing among educators; and policy decisions 
such as a released teacher to coordinate ^ the program and to 
provide training. 

Central office staff felt that involvement with ML provided 
them with an understanding of individual roles in a project. 
School administrators felt that ML enabled them to learn about 
a new teaching strategy, made them more aware of the necessity 
of planning, and resulted in better cooperation with staff. 

Ratings of classroom level impact (e.g.,^ ML is a worthwhile, 
workable instructional model) were positive and were expressed 
in relation to the use of a structured, consistent lesson 
format with clearly specified objectives, fewer gaps in skill 
development, and the second chance given to students to master 
the material. 

Teachers increased their knowledge of the components of effec- 
tive teaching and improved their skills in a new teaching 
technique, in organization/planning, in the effective use of 
time, in the components of effective teaching, and in assessing 
and addressing students' needs. Strengthened attitudes/ 
perceptions of> what students, can accomplish, of the value of 
specific components of effective teaching, and about teaching 
in general were also seen as teacher impacts of ML. 

Cognitive student impact was perceived to some degree by 
educators, and evidenced in incr-eased retention/mastery of 
facts and skills and in test scores. Although student 
achievement was not thev main thrust of the' project, on 
criterion-referenced tests after first time implementation of 
ML, 95% of a random sample of classes scored within expected 
norms (mastery is defined as 80% of the students achieving 80% 
mastery) . Gains are expected to increase with increased 
curriculum alignment and unit sequencing.* 

' Affective student impact was perceived by educators in terms 
of increased confidence and improved attitudes about learning 
and school in general, and awareness of their own strengths 
and weaknesses. Educators were less sure about ML impact on 
behavior/discipline. ^In comparison to national norms,. ML 
students perceived higher levels of competitiveness, friction, 
and favoritism, and lower levels of difficulty, but in all 
other LEI dimensions there. were relatively little differences 
between ML scores and national norms. 



* Currently no student experiences ML for a full course or semester for 
subject, so • cause-effect conclusions caanot be drawn systematically. 
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• Participant Concerns , Baltimore City educat-'-s expressed 

model-specific concerns (e.g., ML Is dlf f leu} r to use with ^1 
some subjects/topics; It requires too much tlnie/ef f ort on 
record-keeping and In general; and It reduces curriculum 
coverage)^, and concerns related to the process of Implemen- 
' tatlon (e.g.. Insufficient time for preparation. Inflexible 
LEA budget process, and unclear evaluation guidelines from 
MSDE) . ^ 

Changes/recommendations reported by Implementers fell Into the 
areas of classroom implementation (e.g. , >develop/use compu- ' 
terized record-keeping systems or provide more clerical help), 
implementation/preparation ^e.g., increase preparation time, 
increase the number of ^teachers involved In curriculum/unit 
development, and begin sequencing units), and expansion 
(increase the number of teachers, schools, students^ and 
subject areas). 

Factors influencing relative success included: (1) central office 
Interest and support; (2) involvement of the principal for planning and ' 
leadership; (3) the dedicated and enthusiastic leadership and' extensive 
support and training efforts of the teacher-coordinator; (4) administrative 
decision to release that coordinator from rerular classroom responsibilities; 
(5) the hard work- knd continued involvement of the teachers. Overall, the ' 
program at Forest Park involved teachers in many activities to contribute to 
, their professional growth— appropriate since staff development was a major 
project objective. However, that diversity across disciplines resulted in 
many little pieces of work in a lot 'of areas with no concentrated effort in 
any given subject. If impact is to be made on students, educators may need t 
continue development of sequenced units for a complete course or semester in 
those subjects most likely to prove rewarding.. If impact on teachers' 
instructional expertise (knowledge of ML and related areas, skill in using th( 
ML model or appropriate components in relation to student needs, eti,.) 
continues to be a primary objective, educators may consider how to "keep 
alive" positive 'interest among teachers and/or expand— either the knowledge 
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base and level of expertise, or to other schools. It might also be useful fo 

project participants to clarify theiT understanding of the relationship 

between the two goals of staff development and student achievement, and the 

appropriate -levels of effort to be/ contributed to each. 

Baltimore County. Baltimor^ County has been implementing ML for. two ' 

years using a lighthouse strategy. In September 19^2, Baltimore County 

educators had "hoped" to achie4 three objectives (i/e, , ■improving teachers' 

classroom competence, helping^teachers become better organized, and improving 

time-on-task) and had "partly achieved" the remaining four objectives 

/ < 
specified in Table 18 (with/the exception of improving student achievement: in 

other subjects and improving students' involvement in learning which were not 
considered as objectives)./ In June 1983, three objectives (improving student 
achievement in the basic /skills , informing local educators about the model,, 
and ensuring a match of instruction, curriculum, and tests) had been 
"achieved." The remaining four relevant objectives had been "partly 
achieved." The. only objective which did not increase in status between - 
September 1982 and June 1983 was training educators to use the model, which 
remained as "partly achieved." In June 1983, an additional objective not 
specified in September has been achieved— evaluating the effectiveness o£ 
"second generation t/raining." 



• Scope and Intensity. After the first year of ML implementa- 
tion (June 1982), ML was being implemented in one elementary 
school with' three teachers and 80 students im mathematics. As 
of June 1983, three elementary schools, 13 tea^chers, and 325 
students w^re involved in ML in mathematics. \^ 

o Fidelity. / Baltimore County educators implemented ^^L with a 
high degree of fidelity. The three ML processes that were not 
addressed , 'by all the teachers were the breakdown" of objectives 
into component skills, the testing of both higher and lower 
order thinking skills, and record-keeping. The largest number-. 
of teachets reported that "no fault" formative and summative /, 
. testing Were the ML components having the greatest impact 'on- ' 
students,' 



» Time Educators spent an average of approximately 10 months 
involved in SITIP across the 1982-83 school year. Teachers 
reported spending an average of 50% of their school week on 
SITIP-related activities. ML required teachers to spend more 
time preparing students (e.g. .. grouping, pretesting) and 
allowed less time for curriculum coverage. 

School administrators spent an average of four, days and 
central office staff* an average of 20 days on SITIP activi- 
ties. Central office staff reported- that SITIP took about the 
same amount of time and energy, and school administrators felt 
that .5ITIP took slightly less effort than similar previous 
projects. 

Roles and Responsibilities. Central office staff spent the 
most amount of time and energy for ML on evaluation (4.00)** 
and the least amount of effort on materials development 
U.30). School administrators did not spend any time on 
inservice and little time on any of the remaining activities. 
The^most effort was spent on supporting school implementation 

Most of the training was done by developers, MSDE, and central 
office staff The two pilot teachers were also given release 
cime to coach new teachers using ML. 

Interactive support received from the five role groups 

^'^'^ ""^^ perceived by educators as average or 
above with the exception of teachers' ratings of developers. 
l^ni . T u^^^^^ received the highest ratings and 

MSDE a^d developers the lowest. Teachers gave the lowest 
ratings except to MSDE where central office staff gave a lower 
rating. By the beginning of June 1983, information had been 
received by 50% of the school administra tors and hy 25% of all 
other educators. Training had been received by 25% of the 
staff and school administrators and by about 
/\°r / teachers and other faculty. No central office 
.r^^pJ/^ °^ educators in the district had 

ImEact . MT. has had an impact on training ^nd on the schoo^ 
system che educators and the students involved. In the area 
Of training all of the teachers reported understanding the " 
model and felt that their teaching ability had improved as a 
result of being involved in SITIP. 

System-wide impact of ML has been in terms of increased 
knowledge of the research on effective teaching, commitment 
cooperation, and sharing among educators, and policy decisions 
such as releasing teachers to provide training and coaching. 



Central office staff were ^Iso involved with , Student Team Learning. 

Level of effort was rated on a scale from 0 (none) to 5.00 (a great deal). 
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Central office staff felt that Involvement with ML provided 
them with knowledge of- new training strategies and the oppor- 
tunity to share ideas with other educators. School adminis- 
trators felt that SITIP involvement enabled them to learn a 
new teaching strategy. 

Ratings of classroom level impact (e.g., ML is a worthwhile, 
workable instructional model) were positive and .were expressed 
in terms of the use of a structured, consistent lesson format " 
with clearly .specif ied objectives. 

Teachers increased their knowledge of the curriculum/program, 
improved their skills in a new teaching technique and in 
organization/planning, and strengthened their attitudes/ 
perceptions of teachers' confidence and self image, about 
teaching in general, and of the value of specific components 
of effective teaching. 

Cognitive student impact was perceived by educators and 
evidenced in test scores. On the Metropolitan Achievement 
Test, ML schools showed larger gains from pre to post tests in 
comparison to comparable non-ML schools, especially in .the 
third grade scores. These gains exceeded normative predic- 
tions. ' V , 

Affective student impact was perceived by educators in terms 
of increased confidence and improved attitudes or awareness 
about their learning responsibilities, about learning and 
school in, general, about tests, and of their specific areas of 
strength and weakness. Educators were less sure about the 
effects that ML had on improving student behavior /discipline. 

• Participant Concerns . Baltimore County educators expressed 
model-specific concerns (e.g., it is difficult to find appro- 
priate enrichment activities, ML requires too much time/ 
effort, it holds back academically talented students). 
Changes/recommendations reported by . implementers fell into the 
areas of implementation — preparation (e.g., increase prepara- 
tion time), involvement (e.g., compensate teachers for after 
school training/planning), expansion (e.g., increase number of 
teachers, students, schools, subject areas; and before 
expansion,, measure impact on student achievement) , and 
external assistance (e.g., MSDE should provide research 
updates on school improvement). 

Factors influencing relative success included: 1) a stable ,cross- 
hierarchical team with strong mutual respect and sincerity among members; 2) 
strong commitment, hard work, and professionalism by teachers; 3) thoughtful 
support from central office staff and school based administrators, with atten 
tion to careful planning and data-based decision-making. Initial implementa- 
tion was relatively small-scale, with attention focused on one subject area: 
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decisions to expand were based on proven "objective'* value (student test 

0 

scores increased) and on "subjective" value (teachers found ML useful for 
mathematics in grades three and four). Baltimore County has successfully 
applied SHIP processes and is implementing ML with a high degree of fidelity 
In considering improvements, educators may analyze test items to determine 
frequency of use of higher order cognitive skills, and either redesign 
grouping procedures or develop appropriate enrichment activities to. satisfy 
the needs of academically talented students. 

Carroll County. Carroll County has been implementing ML for one year 
using a lighthouse strategy. By June 1983. allbut one of the nine objec- 
tives specified in Table 18 were achieved for pilot teachers and students. 
Improving student achievement in other subjects besides basic skills was 
"hoped for." ^ 

• Scope and Intensity. After the first year of implementation \- 
(June 1983):, l-IL Was being implemented in one middle school by 
two teachers witl| approximately 160 sixth graders in social 
studies. The teachers developed and implemented one unit in 
economics using ML. 

• Fidelity . The Ckrroll teachers implemented ML with a high 
degree of fideli|:y. All ML components with the exception of 
record-keeping were consistently addressed by both teachers. 

• Time, Educators spent an' average of eight months involved in 
ML across the 1982-83 school year. Teachers reported spend- 
ing an average of 3% of their school week across the entire 
school year on SITIP-related activities. ML required teachers 
to spend more time preparing students (e.g., grouping, pre- 
testing) and allowed less time for curriculum coverage. 
Central office staff and school administrators spent an 
average of 6.5 to 7 days on SITIP activities. Central office 
staff spent slightly less time and energy on ML in comparison 
to similar previous projects. 
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Roles and Responsibilities , Central office staff spent the 
least amount pf time and energy on Inservlce and evaluation 
(1.00. for each activity)* and the most amount of time on 
administration (3.00). School administrators spent no time 
on materials development and evaluation and spent equal 
amounts of time on supporting school implementation and 
dissemination (3.00 for each activity). 

The training was done by developers, MSDE, and central office 
staff. Assistance was also provided by ML implementers in 
Howard County. Interactive support received from the five 
role groups Involved in SITIP was perceived by educators as 
above average with the exception of central office staff who 
rated developers as below average. Teachers and central 
office staff received the highest ratings of support. By the 
beginning of June 1983, at least 75% of the local educators 
in all three role groups received information about ML. Most 
of the educators directly Involved in the project (one school 
had received training and help . 

Impact . ML has had an impact on training and on the pilot 
school, the educators, and the students involved. In the 
area of training , both pilot teachers reported understanding 
the model and felt that their teaching ability had improved. 

School-wide impact of ML has been in terms of improved 
teaching and learning in general and a "carry over" of ML 
techniques to other subject areas. 

Central office staff felt that involvement with STTTP made 
them more awar^e of the importance of reteaching. School 
administrators . felt that SITIP involvement enabled them to 
learn about a new teaching strategy. 

Ratings of classroom level impact (e.g., ML is a worthwhile, 
workable instructional model) were positive and were expressed 
in relation to the use of a. structured lesson format with 
specified objectives. 

Teachers increased their knowledge of the curriculum/program, 
of the components of effective teaching, and of the learning 
process. They improved their skills in a new teaching 
technique, in organization/planning, and in curriculum 
development. 

Cognitive student impact was perceived to" some degree in 
increased mastery/retention of facts and skills. On three 
summative tests given during the implementation of the ML ' ' 
unit, mastery levels were achieved (at least 80% of the 
students achieved 80% correct answers). 



Level of effort (time and energy) was rated on a scale from 0 (none) to 5.00 
(a great deal) . ' v / ^.uu 
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Affective student impact was perceived by educators in terms 
of enjoyment of the ML process. Educators were less sure 
about whether ML had an impact on behavior/discipline. On 
the Student Questionnaire, scores increased (pretest-posttest) 
on recognition of differences between ML and non-ML classes, 
enjoyment of lessons, ease of lessons, better grades, and 
better lessons (slightly). 

•. Participant Concerns. Carroll educators expressed model- 
specific concerns (e.g., it is difficult to group students 
for correctives/extensions; ML requires too much time; ML 
could hold back academically talented students). 

Changes/recommendations reported by implementers fell into the 
areas of implementation— preparation (e.g., more preparation 
, time; increase the number of teachers involved in curriculum/ 
unit development), expansion (e.g., increase numbers of 
teachers, students, schools, subject areas), and external 
assistance (e.g., mdSE should provide more funds and encourage 
more inter-county networking) . 

Factors influencing the relative success of the project included: 1)' 
educators' willingness to learn from other ML SITIP sites, and the willingness 
of participants at those sites to share ideas and provide assistance (net- 
working); 2) active support from the principal and central office supervisor.' 
as demonstrated in unit development activities, arrangements for site visits 
to other ML LEAs. and arrangements for release time for teachers to be 
involved in. those activities; knd 3) the initial use of time for participants 
to understand ML, fully before developing materials or teaching units." In 
order to determine the relative value of ML, educators may need to develop 
enough units for a class of students to experience ML for a complete course or 
semester. In order to share the perceived benefits of the activities (e.g., 
curriculum development, professional expertise) , educators may want to expand 
the SITIP team or find ways of including more teachers. ' In general, Carroll 
has progressed carefully, seeking after quality of understanding of the model, 
and application reflecting positive experiences of other sites. Fidelity to 
'™ P'^''".^^^^^"^ tp ML has been high and appears to have been effective for 
this first year of implementation. 
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Howard County, Howard County has been Implementing ML for two years 

using a lightliouse strategy. In September 1982, educators "hoped" to improve 

student achievement in other subject^-^^sides" b^^^^ skills, and had "partly 

achieved" the remaining eight objectives specified in Table 18. By June 

the eight "partly achieved" objectives had been "achieved." The status of 

improving student achievement in non-basic skills subjects remained unchanged. 

• Scope and Intensity. After theyfirst year of implementation 
(June 1982), ML was being implemented in one middle school by 
two teachers in reading/language arts and social studies. By 
June 1983, nine teachers and 260 studeut^^were using ML in 
readipg/language arts, mathematics, science, and social 
studies^ 



Fidelity , Howard^educators implemented ML with a high degree 
of fidelity. The ML components leaVt consistently addressed 
were matching curricula to objectives and record-keeping. 
All of the other components were consistently addressed by 
the teachers. The Howard teachers felt that the "no fault" 
formative and suramative testing, the correctives and exten- 
sions, and the ML rationale that every student can succeed 
were the aspects of ML having the greatest impact on 
students. 

Time, Educators spent an average of nine months involved in 
ML across the 1982-83 school year. Teachers reporteS spend- 
ing an average of 75% of their school week on SITIP-related 
activities, during periods when ML units were being imple- 
mented. 

ML required teachers to spend more time preparing'^students 
(e.g., grouping, pre-testing) , but did not take a donger 
amount of time for curriculuni coverage. The school adminis- 
trator spent an average of 25 days and the central office 
staff respondent an average of seven days on ML activities. 
The school administrator reported that ML took substantially 
more time and energy while the central office person reported 
substantially less time and effort spent on ML in comparison 
to similar previous projects. (This reflects the status of 
project leadership.) 

Roles and Responsibilities , The central office staff perso.. 
spent no time on materials development and the most amount of 
time OP dissemination (4.00)*.. The school administrators 



Level of effort (time and energy) was rated on a scale from 0 (none) to 
5.00 (a great deal). 
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spent the least amount of time on materials development O 00) 
and a great deal of time (5.00) on each of the remaJning 
activities specified. ^ 

The teachers received most of their training from MSDE and 
developers. By the beginning of Junje 1981. information, 
training, and help had been received by about 25% of school 
administrators and teachers at the SITIP site. 

• Impact . ML has had an impact on training and on the school 
educators, and students involved. In the area of trainine ' 
\ teachers -reported understanding the model. 

School-wide impact of ML has been in terms of release time 
for planning, and teacher enthusiasm, with some grass roots 
expansion to other subject areas and teachers. 

.Central office stiaff and school administrators felt that 
involvement with ML enabled them to learn about a new 
teaching strategy. 

Ratings of classroom level impact (e.g., ML is a worthwhile, 
workable instructional model) were positive. Teachers 
improved their skills in a new teaching^" technique , in ' ' 
organization/planning, and\in the components of effective 
teaching. They strengthened their attitudes/perceptions of 
^ what students can accomplish\ and about teaching. 

Cognitive student impact was perceived by educators who said 
that test scores increased. (For instance where 53% students 
• ^r.H ? awarded grades of "d" or 'T' , only 20% received such 
grades in ML classes. Where students received "D" or "E" on 
formative tests, only 4% received such grades in summative 

u 6 S C S • ^ 0 

Affective student impact was perceived by educators in terms 
Of enjoyment, improved attitudes or awareness about their 
learning ability, about learning and \school in general, and 
improved behavior/discipline. .cina 

• Participant Concerns. Howard educators expressed model- 
specific concerns (e.g., ML requires too much time/effort) 
Changes /recommendations reported by implementers fell into' 
the areas of involvement (e.g.. encourage teachers to inci^se 
knowledge and skills) and expansion (e.g., increase number of 
teachers students, schools, and subject areas). 

Factors influencing the relative success of ; the project include: 1) 

implementation in the first year was slow to sta^t and participants shared 

little With other ML LEAs; 2) there was some misunderstanding of roles and 

responsibilities; 3) clarification across hierarchical levels" and of specif 
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applications helped to focus efforts; 4) some successes (especially In 

teacher teaming) were experienced, acknowledged, and shared (e.g., with 

Carroll visitors), and the project gained significance. Educators may need t 

use ML for a complete course and then determine relative cost-effectiveness 

(since some participants think ML takes too much time and effort). They may 

also explore ways to capitalize on the positive impact and possibly include 

more teachers. Their networking activities appear to have been successful, 

and opportunities to learn from and share with other LEAs should be taken, I: 

general, Howard appears to have a viable project that still needs nurturing t 

» 

get it firmly in place. 

Worcester County . Worcester has been implementing ML for two years 
using a lighthouse strategy. In September 1982, educators "hoped" to achieve 
improved student achievement in other subjects besides basic skill areas and 
to inform local educators about the topic. "Partly achieved" objectives 
included training educators^ to use the model, and improving time-on-task. 
The remaining four objectives specified in Table 18 were "already achievedT^'. 
In June 1982, three objectives (improving student achievement in basic 
skills, helping teachers become better organized, and improving students' 
involvement in learning) decreased in status from "achieved" to "hoped for" 
for the first objective and to "partly achieved" for the latter two 
objectives. The remaining six objectives did not change status from Septerabei 
to June.. (Relative achievement of objectives may have remained the same or 
decreased from September to June since the same objectives may have been 
addressed but with different classes of students.) 

• Scope and Intensity . After the first year of implementation 
(June 1982), ML was 'being implemented in one elementary 
school with five teachers and 100 students in mathematics. 
By June 1983, four teachers and 75 students from the same 
school were using ML in mathematics. (The reduction was due 
to decreased enrollment.) 
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• Fidelity. Worcester educators Implemented ML with a high 
degree of fidelity. The ML components least consistently ■ 
addressed by the teachers were the Inclusion of higher and 
lower order thinking skills on tests, and the "no fault" 
formative test given for each unit. Teachers reported that 
correctives and extentlons, guided practlc2, and the ML 
philosophy were the aspects of ML having the greatest Impact 
on students. 

• Time. Educators spent an average of 9.5 months ini>olved in 
SITIP across the 1982-83 school year. Teachers reported 
spending an average of 14% of their school week on SITIP- 
related activities. ML required teachers to spend more time 
preparing students (e.g., grouping, pre-testlng) and allowed 
less time for curriculum, coverage than previously used 
instructional methods,. 

School administrators spent an average of 17.5 days and 
central office staff an average of 15 days on SITIP-related 
activities.* School administrators and central office staff 
felt that SITIP required r,llghtly more time and energy than 
had \slmllar preylous projects. 

• Roles, and ResponslBllit-es. Central office staff and school 
administrators for ML spent the least amount of time and 
energy, on materials development (3.00 and 1.00, respectively) 
and the most amount of time on administration (central 
offlceyA.OO) and evaluation (school administrators— 4.50) . 
The training was done by developers, MSDE, central office 
staff, and school-based staff —school administrators and 
teachersl Interactive support received from the five role 
groups Involved in SITIP was perceived by educators as average 
and abovey Teachers received the highest ratings and school 
administrators the lowest. By the beginning of June 1983, 
Information had been received by all central office staff and 
school adm'lnistrators and by 25% of the teachers, Training 
and hel£ hkd been received by 25% of the teachers at the pilot 
site. ■ 

• Impact . MlJ has had an Impact on training and on the system, 
school, educators, and students Involved. . in the area of 
training, 5J% of the teachers understood the model and 43% 
felt they needed to learn more. All of the teachers felt 
that their teaching ability has Improved as a result of ML. 
System-wide Impact on ML has been in terms of sharing among 
educators, cross-hierarchical steering committee was 
formed. Members Include teachers, the principal, two central 
office staff, a school board member, and a parent. The 
chairperson Is a school-based administrator (curriculum 
coordinator) . The .committee reviews project activities and 

* Central office staff were. also Involved in Student Teair Learning^. 
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results and submits requests and recommendations to the 
central office. School-wide impact has been in terms of 
teacher enthusiasm, concern for achievement, and the develop- 
ment of simplified, sequenced objectives for .mathematics. 
Teachers team for each grade level to develop daily, lesson 
plans, ,and the principal^monitors implementation. 

Central office staff felt that involvement with SIJIP gave 
them a better knowledge of av.iilable teaching techniques, 
while school administrators gained in respect for those 
educators using ML. 

Ratings of c lassroom level impact (e.g., ML is a worthwhile, 
workable instructional model) were positive and were expressed 
in terms of clear teacher expectations, less pressure on 
students, and the opportunity to relearn — correctives and 
extentions. 

Teachers increased their knowledge of the curriculum/program 
and of the components of effective teaching. They improved 
their skills in a new teaching technique, in organization/ 
planning, in the components of effective teaching, and in 
assessing and addressing student needs. Teachers also 
strengthened attitudes/perceptions about teaching 

Cognitive student Impact was perceived by educators and 
evidenced in increased mastery/retention of facts and skills 
and in test .>rcres. On unit summative tests , at least 97% of 
the studen\>j uiing ML for the entire school year achieved 
mastery at cV>e 85% level, and on an end of the year compre- 
hensive test at least 97% of these students were achieving 
mastery with an average- score of 96%. Pre and post test 
scores on the CAT showed significant growth beyond normal 
predictions, with significantly lower standard deviations. 

Affective student impact was perceived by educators in terms 
of enjoyment and improved attitudes, and awareness of their, 
learning capability and of their strengths and weaknesses. 

On the My Class Inventory , students answered as teachers pre- 
dicted, with high levels of agreement with competitiveness 
and satisfaction, lower levels on difficulty, and uncertainty 
about friction. 

Participant Concerns . Worcester educators expressed model- 
specific concerns (e.g., ML requires too much time/effort; ML 
holds back academically talented students). Changes /recom- 
mendations reported by implementers fell into the areas of 
implementation — preparation (e.g., increase preparation time^ , 
involvement (e.g., have only voluntary participation, compen- 
sate teachers for after school planning/ training) , and^ 
expansion (e.g., increase the number of teachers, schools, 
students, and subjects). 
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Factors influencing relative success included: 1) time re:quired for 
plauning, disagreement among teachers, and perceived lack of. central office 
support contributed to some teachers' reduction in commitment and reluctance 
to expand the project; 2) increases in standardized test scores influenced 
central office staff wish to expand the project, but some teachers did not 
agree with expansion without additional consistent support and assistance; 3) 
some teachers felt overwhelmed by the work although an outside consultant was 
hired to develop materials; 4) assistance (by MSDE and lo'cal administrators) 
was perceived as "spotty-a lot all at once and then nothing at all.'!, . within 
the pilot school, a great deal of development work has been done and more is 
planned for ML to spread up through the grade ievels. Standardized test data 
and the perceptions of educators indicate a strong objective value of the 
program. Various strategies and development efforts (e. g. , the "phasing in" 
of third grade teachers, and the development of an efficient record-keeping 
system) are providing support for teachers. Beyond the pilot school, there is 
little evidence of planning for expansion. During the 1983-84 school year, 
educators may need to review their own experience and determine appropriate 
strategies if expansion is to occur beyond the pilot school. ,. 

student Team Learning (STL) 
As stated in Chapter II, Student Jeani' Learning (STL) is a technique which 
uses peer tutoring and team competition to facilitate student learning. 
During 1981-82, eight LEAs (Baltimore County. Calvert, Charles, Montgomery. 
Prince George's, Queen Anne's, Washington. , and Worcester) implemented STL. In 
1982-83, one additional county (Dorchester) ,, became involved in STL. fhis 
section describes the implementation, of STL including: planning, scope and 
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intensity of implementation; time spent on implementing STL; roles and 
responsibilities of STL implementers; STL impact on school systems, individual 
schools, educators, and students; and participant concerns. 
Planning 

The extent of involvement of STL implementers in MSDE-organized 

planning ractivities during the 1981-82 school year Is summarized below: 

Overall, Baltimore, Queen Anne's, Washington, and Worcester 
, counties were the only LEAs that involved ^cross-hierarchical 
teams in at least... two planning activities.... School 
administrators were more heavily involved in. . .planning than r, 
central office staff and teachers. Central office staff and ^ N 
teachers were fairly equally involved in. . .planning. (Roberts / '\ 
et al. , 1982) 

For the 1982-83 school year, MSDE did not organize any group planning 
activities but provided individual assistance in. preparing PEPPS proposals- 
to the "new" LEA. Only one veteran STL LEA changed its original plans: 
Washington County modified its SITIP plans for 1982-83 so that the leadership 
role would be assumed by the teacher center and the project would be main- 
tained at 1981-82 levels (i.e., the original. goal for scope and intensity 
would not be achieved). 

An analysis' of local plans for the 1982-83 school year identified LEA 
objectives and the status of each at tlie beginning of September 1982.* 
Table 30 preseiits the objectives. In each case, the percent of LEAs that 
"hoped for," "partly achieved," or "already achieved" each objective is 
indicated. As can be seen in Table 30, there were nine objectives identified. 
All nine were addressed to- some extent in the participating ^LEAs. Informing 
local educators about the model and training educators to use the model were 



^ New LEAs were not required to* submit information on status of objectives int 
September 1982. 
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Table 30 , . 

Seatus^^of local Objectives", 1982-83: Student Team Learning 



Local Objectives 



1. Improve student achievement 
(basic skills). 

2. Improve student achievement 
(other subjects). 

3. Inform local educators about model. 
^. Train educators to use model. 

5. Improve teachers' classroom 
competence. ~ 

6. Ensure match of instruction, 
curriculum^ and test(s). 

7. Help teachers become better 
organized. 

8. Improve time-on-task. 

9. Improve students' involvement in 
learning (motivation) . 



10. Other — dissemination of STL. 

U. Other — evaluate usefulness of 
STL as a teaching strategy. 



9 



Hoped for • 
Partly acliievsd 
Achieved • 



ERIC 



N 



2 

■7- 



Status 



Pre-(Sept. 1982) 



Percent of LEAs 



1* 



43 



50 



25 



25 



17 



33 

50 

43- 



2* 



57. 

50 

62 
50 
66 

50 

67 

50 
-43 



3* 



13 
25 
17 

50 

0 

0 

14 



' Post-(June 1983) 



N 



8, 



Percent of LEAs 



1* 



14 



2* 



67 



72 



43 



62' 



62 



50 



86 



60 



29 



Mi- Total number of LEAs equals 9. 



3* 



33 



14 



57 



38 



38 



50 



14 



40 



71 



the two objectives addressed by the largest number of counties. Improving 
tlme-on-task was the least addressed because it is not a component of STL. 
Five objectives were already achieved by some of the LEAs as of September 
1982. The remaining four objectives were either "hoped for" or "partly 



achieved'" by .^e LEAs addressing those objectives. One LEA specified an 
additional objective — dissemination of STL. 
Scope and Intensity of Implementation 



In 



schools 
and 103 



September 1982, nine counties were involved in STL. Dorchester was 

just beginning its involvement. As can be seen in Table 31, in June 1982 

I 

scope and intensity of implementation varied among the eight "veteran" LEAs 

I 

from thpe teachers and 66 students in one junior high/middle school in one 
county to 21 teachers and 1,500 students across 16 elementary and secondary 
in another county. Across the eight LE^s, approximately 25 schools 
teachers in a variety of subject areas were Involved in STL. 
Table 32 presents the scope and intensity of STL implementation in June 
1983.* Across the eight reporting LEAs. a variety of implementation 
-TJtrair^gies were being used (lighthouse schoolr-3; pilot district— 2; capacity 
bullding--3). Approximately 113 teachers in 42 elementary and secondary 
schools were implementing STL. The majority of the LEAs were using STL in the 
basic subjects of reading/ language arts, social studies, mathematics, and 
science. Three LEAs tried STL in additional subject areas. 

The percentage of schools in each reporting county implementing STL as 
of June 1983 ranged from .6% in Montgomery County to 50% in Dorchester 
County. Across the entire state, 3% o5 the schools were involved In STL at 
the end of the 1982-8.3 school year. 



ERIC 



No data available for Prince George's County. 
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. Table 31 

Scope and Intensity, Junfe 1982:^ Student Teani Learning 



■ LEA . 


Strategy 


//of 
Schools 


Type 


1 of 
■ Teachers 


1 of 
Students 


, Subject Areas 


Baltimore County 




2 


" e, J/H 


7 


■ 250 ■ 


R/LA, M, Sc, SS 


Calvert 


LS 


1 


J/M 


3 


66 


R/LA, SS 


Charles 


LS 


1 


J/M 


17 


500 


R/LA, M, Sc, SS 


Dbrchester 


New District 






Montgomery 


LS 


. I 


J/M 


8-9 


250 


R/LA, M, Sc, 0 


Prince George's 


CB 


16 


E, J/M, H 


^ 21 


1,500 


R/LA,' Sc . 


Queen Anne's 


CB 


■p . 


H 


, 23 ' 


500 


R/LA, M, Sc, SS, 0 


Washington 


CB 


2 


E, J/M 


8 


" 300 


R/LA, SS,'o 


• Worcester 


CB 


1 


. E ■ 


15 


302 


R/LA, M, Sc, SS, .0 



Subject Areas ; R/LA^Reading, language arts 
M=Hatheiiiatics 
Sc=Science 
rSS=Soclal^ Studies 
O'Other ' 



Strategy : LS^Lighthouse 

PD=Pilot district 
DW^District wide 
CB=Capacity building 



ERIC 



. Tjrge: E^Elenentary school 
J/M=Junior high/middle 
Y^M ; H=High school 
'^^^ O^Other 
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Table 32 



Scope and Intensity, June 1983: Student Team Learning 



r 

■ 

LEA 


Strategy 


1 of 
Schools 


Type 


■ 1 of 
Teachers 


lof. 
. Students 


Sublect Ar^fl<? 


Baltimore County 


' PD 


2 


E, J/M 


9 


225 


R/LA, M, So, oS 


Calvert' ' 


LS 


3 


E, J/M 


10 


' 300 


R/LA, M, SS, 0 


Charles 


. LS 


10+ 


E, J/M 


17+* 


650+* 


R/LA, M, Sc, SS 


Dorchester 


PD ' 


7 


E 


8 . 


111 


SS 


Montgoiery 


LS 


;i 


J/M 

/ 


10' ■ 


■ 480 


R/LA, M, 'Sc 


Prince George's 


■ No Data 




0 


Queen Anne's 


CB • 


1 


H 


23 • 


900 


R/LA, M, Sc. n 


Washington 


CB 


u 


E, J/M, H 


20 


500 


R/LA, SS. 0 


Worcester 


CB 




E, J/M 


16+ 


400 


.a 

R/U, M, Sc, SS 


riiot miaaie sctiool only. ^ 









SubjecUisas: R/LA=Reading, language arts. 
JiO M=Matheiiiatics 

Sc=Science 
SS=Social, Studies 
' , . 0=Gther . 
, , 5[£e: E=Elenientary school 

o ■ • J/M-Junior^high/middle 
ERIC' - Wgh school . 

"~" .0=Other 



^t^ategy ; LS^Lighthouse school 
PD=Pilot district 
Wistrictwide 
CB=Capacity building 



Some changes occurred between June 1982 and June 1983. the most obvious 
being the one new LEA. Dorchester decided to use a pilot district strategy 1 
seven elementary schools with eight teachers in social studies, m general, 
the scope and intensity of implementation increased in the seven "veteran" 
LEAS between June 1982 and June 1983 (no comparisons can be .ade for Prince 
George's County). None of the seven districts changed its implementation 
strategy. Four LEAs increased in number of schools. There were increases in 
the number of teachers implementing the model in six LEAs. The number of 
students involved increased in six LEAs. Subject areas were increased in one 



LEA. 



STL includes four strategies-STAD. TGT. Jigsaw, and TAX. None of the 
• teachers responding to the General Survey (n=62) were using the new strategy. 
TAX. during the 1982-83 school year. The largest percentage of survey respon- 
dents (59.7%) were using. STAD. followed by TGT (45.2%) and Jigsaw (24.2%). 

Scope and intensity of implementation also includes fidelity-the extent 
to which teachers implement the model as designed. STL. as designed, requires 
the implementation of five components or processes which are listed in their 
order of importance, 

2' M^^L'Sr ^"'=1"''^= » "^^ °f I'ln'ls of students (on given crlterlal 
5, Successes are publicized. 

Of the 62 teachers responding to the General purvey. 33% carried out all 
five components or processes. The process most consistently addressed (by 95% 
Of the teachers) was the most important: . each team includes a mix of kinds of 
students. The process • least addressed (76%) was the third H.ost important: 
quiz/tournament scores relate to individual and team achievement. The 



154 

212 



remaining three components were addressed by at least 82% of the teachers. 
Teachers indicated that the most important components (in terras of instruc- 
tional value) V7ere shared responsibility for and effort toward team success 
and team recognition. While individual teachers at some sites maintained high 
fidelity, in general, fidelity across all the LEAs was not as high as 
expected. 

Time Spent on che Model 

This se»ction discusses the time spent on STL during the 1982-83 school 
year. Time across the school year is discussed first, followed by a 
discussion of the time spent by teachers in fhe classroom and by school 
administrators and central office; staff** 

Across the school year . During 1981-82, the iriajority of STL implementers 
began using the model in September and October 1981 and continued using it 
through May 1982. However, a few teachers did not begin implementing mtil 
April 1982, and in two counties u few teachers had stopped implementing STL as 
early as February and March 1982. 

During the 1982-83 school year, implementers across seven counties were 
involved in SITIP for an average of 5 mouths. Implementers in all seven 
districts were involved for at least 3 months. Queen Anne's and Montgomery 
counties had the lowest and Baltimore County had the highest average number of 
months of involvement. Time allocations relate to the units of in'struction in 
which STL is used. In general, a given'class of students rarely participated 
in STL for more than two units during the year (e*g., TGT in the fall for 
mathematics. Jigsaw in early sprix.^ for science) . 



This information is based primarily on the responses of a sample of imple- 
menters who completed the General Survey. No survey data were available for 
Prince George's and Washington counties. 
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In the classroom. The amount of time STL was used in the classroom 
during 1981-82 is summarized below: 

Once implementation began, the majority of the teachers (64%) 
used STL up to 25% of the time and the rest of the teachers 
used it from 26% to 50% of the time. Only one teacher used it 
more than 50% of the time. Teachers seemed to be tising STL 
occasionally for certain units or for certain topics within a 
.unit. (Roberts et al., 1982) 

In 1982-83, the teachers responding to the General Survey (N=42) indica- 
ted that they spent an average of 21% of their -school week on STL-related 
activities.. The primary activity for the majority of teachers was classroom 
implenentation. However, some teachers also spent time on planning and/or 
training. Elementary teachers using STL in one or two subject areas spent an 
average of 15% of their school week implementing STL. Secondary teachers 
using STL irt their specific subject areas spent a larger percentage (23%) of 
their school weekj involved in STL. These time allocations relate to periods 
when a given unit of instruction incorporated STL. 

Tn general, llpcal educators indicated that STL required teachers to spend 
more time > preparing students (e.g., grouping, pre-testing) and either 
disagreed or were unsure about whether the curriculum could be covered in a 
comparatively shorteV amount of time, using STL. Thesie 1982-83 findings were 
consistent with the'results obtained during the 1981-82 school year. 

Time spent by administrators.* Seventeen school administrators and 
central office staff across the seven LEAs providing survey^data^spent an 



average of 9.5 days on SITIP. The average number of days ranged from 26.5 
in Worcester to two in Charles. In general, central office staff spent more 
time on SITIP (17 days) than did school administrators (8 days). 

n f» 

; 

tr^tnirrVJ 1 ^^5"' ^""^ Montgomery counties, or from school adminis 
trators in Charles County. Central office staff in Baltimore, Calvert 
Montgomery, and Worcester ■ counties were also involved with other models 
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Twenty-four central office staff and school administrators reported 
spending about the same amount of time and energy on SITIP as they had on 
similar previous projects. However, central office staff in Calvert and 
Dorchester counties and school administrators in Baltimore, Charles, and 
Worcester counties reported that "slightly more" to "substantially more" time 
and energy had been spent on SITIP, while the school administrator from 

o 

Montgomery County reported /'substantially less." The administrator from ' 
Montgomery County reported spending the least amount of time and energy (1.00 
on a scale from 1.00 "substantially less" to 5.00 "substantially more"), while 
administrators from Baltimore and Worcester counties reported spending the 
most amount of time (4.00). These time allocations reflect the level of effort 
of classroom implementation. 
Roles and Responsibiliti es 

The SITIP design encourages involvement of a cross-hierarchical team, 
including: 1) central office staff, e.g., supervisors in instruction or 
coordinators of staff development; 2) school administrators, e.g., principals, 
vice principals, or department heads; and 3) classroom teachers. This -action 
describes the people involved, what they did, and their relationship to each 
other from three perspectives: usual assigned roles, activities undertaken, 
and interactive support. 

U su^l roles. Teachers, school-based administrators, and central office 
staff were all Involved in STL. Of the nine central office staff responding 
to the General Survey, two were in staff development, three were in instruc- 
tion, one was in research and evaluation, and one was in "another" area. Two 
had multiple re.sponsibilities - Of the 16 school administrators responding 
to the. survey, ten were principals (seven elementary, two junior high/middle. 
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and one no grade level indicated) ancV six were vice principals (three elemen- 
. tary, two junior |high/middle, and o-Ae no grade level indicated), in general, 
STL implementation was carried out about equally by elementary and secondary 
teachers.^ I ' 

'■■ I e ■ 

; I 

Activities and lev els of effort . On the General Survey, six activity 
areas were identified and central office staff and school administrators from 
those LEAssresyjnding to the survey were asked to indicate level of effort 
(ti A nd energy) spent on each (with responses ranging from 0 "none" to 5 "a 
great deal") . / The areas of activity were: 1) administration (including 

planning and budget); 2) development of materials; 3) designing and/or 

i 

conducting tnservice; 4) supporting school implementation (e.g., problem- 
solving, supplying materials, etc.); 5) dissemination; and 6) evaluation. 
(Mean ratings are presented in Table 33.) 

The level of effort spent by central office staff and school adminis- 
trators on each activity during the first year of implementation (1981-82) ig 
suramarlEed below. 

Most effort was spent by central office staff and school 
administrators on providing support to school staff, followed 
by administration, and least effort was spent on materials 
development. Some specific points include: 

• In the three capacity-building and one of the pilot/district 
" LEAs,\^ school administrators spent little effort on adminis- 
tration but their central office staff spent much more. 

o Only four respondents (three of whom were central office 
staf£)\ spent much effort on materials development (a high 
need f 6r STL) . \ 

• ' InserviW effort was, low for about half the respondents in 

each role group. \ 

• Support Was fairly high for all respondents, with the excep- 
tions of^ school administrators in two counties (Washington 
and Worcester) and two central office staff In Prince 
George's]^ \ 

• Dissemina^tion and evaluation efforts were higher for central 
office staff than for school staff, with Washington very low 
in both. URoberts et al., 'l982) . 
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As can be seen in Table 33. during the 1982-83 school year school. 

administrators and central office staff combined spent the ieast amount of 

time on the development of materials (i.62) and the most time on supporting 

school implementation (3.04). Central office staff reported spending more 

time on all- areas than did school administrators. Most central office effort 

was given to administration followed by supporting school implementation and 

dissemination. School administrators spent most of their time oh supporting 

school implementation followed by dissemination. 

Individual county responses indicated that there was some level of effort 

committed to each activity across all of the LEAs. , The greatest amount of 

effort was given to: administration in two counties (Montgomery and 

Worcester); materials development in no counties (received least effort in 

four counties); designing and/or conducting inservices in one county ' ' 

(Charles); supporting school implementation in two counties (Baltimore County 

and Dorchester); dissemination in two counties (Calvert and Charles); and 

evaluation in no counties. STL units can only be taught if appropriate 

materials are available. The lack of investment . in materials development ' 

suggests that teachers (in 1982-83) used materials developed earlier (some by 

the developer, and some exchanged among , teachers or LEAs) . 

Interactive support. Teachers implementing STL could receive training/ 

information from four sources: developers, MSDE, central office staff, and 

school-based staff (school administrators' and teachers). The largest 

percentage of teachers responding to the survey ,(N=6l) received information 

and .training from school administrators and teachers (62%). The lowest 

! ,• ■ \ . 

percentage (25%) received training from developers. 
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All counties received some training from MSDE and STL developers. Also 
teachers In Baltimore County received their training from other teachers; the 
majority of teachers from Charles (81%) and Worcester (67%) counties . received 
their training from school administrators and teachers; and in Queen Anne's, 
67% of teachers were trained by one or more of the local role groups. 

Survey respondent s~wer¥^ask¥d~t'o~^a^te" the support^received - from teachersi- 

principals, central office staff, MSDE, and developers (from 1.00: very poor, 

to 5.00: excellent). Ratings of interactive support from the 1982 survey are 

summarized below: 

...for STL, central office staff were generally the most 
positive "in\ their assessment (average rating of 4.23). School 
administrators were also positive in their ratings of support 
from the three role groups (average rating of 4.14). Teachers 
were, in general, less positive (average rating of 3.56) in 
their ratings. Central office staff and school administrators 
gave the highest rating of support to teachers; teachers gave 
their highest rating to school administrators. (Roberts 
et.al., 1982) 

As shown in Table 34, respondents of the 1983 survey* rated the inter- 
active support received from all five role groups as above average, indicating 
that each role group was perceived positively by other educators Involved in 
STL in terms of providing information, help, and general support." Developers 
received the lowest, and teachers and school administrators the highest 
ratings of support. Central office staff gave the highest ratings while 
teachers tended to be the least positive in their assessments. 

o 

The mean ratings given to the flVe role g^roups by the survey respondents 
in each of the individual counties were all 3.00 (average) and. above except in 
Montgomery County where the school admlrlstrator and teachers rateu central 
office staff below average (1.00 and 2.t r. : "^^ctively) . 



* No data were available from central office staff and school administrators 
in Queen ^Anne's County. 
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Table 34 

Perceptions of Support Received: Student Team Learning, 1982-83 



Respondents 


— - 

N 




Support Groups 


Teachers 


■ School 
Administrators 


Central 
Office Staff 


MSDE 


Developers, 

f 


Central Office 


9 , 


4.62 


4.50 


4.37 


4.44 


4.00 


School Administrators 

r 


17 


4.19 


4.00 


4.23 


4.23 


3.94 


Teachers 


60 


4.03 


4.10 


3.63, 


3.77 


3.63 


Total 


86 


4.12 


4.12 


3.82 


3.94 


3.72 



ratings range froi a low of 1.00 (very poor) to a high of 5.00 (excellent). 



Impact 



This section discusses STL impact on training and on school systems, 
individual, schools, central office staffs, school administrators, teachers, 
and students. 

Training . MSDE TAs held three follow-up training sessions for thos.e 
counties implementing STL. The first session was a combined follow-up held in 
the fall of 1982 at MSDE with participants' implementing AT and TV. Approxi- 
mately 18 STL participants were present. During this joint follow-up, the 
1982-83 evaluation design was reviewed by RBS, and participants met in small 
model-specific groups to review plans and to share needs and concerns. The 
second session was hosted by the pilot school in Charles County, and the third 
follow-up training session was hosted by schools in Queen Anne's and Worcester 



counties. Each of the latterX^o sessions consisted of classroom observations 



spring session, a presentation on planned change was made by RBS staff. 

STL participant evaluations of follow-ups (e.g., clarity, relevancy, and 
accomplishment of objectives, support from MSDE) were positive, the mean 
responses ranging from 3.69 to 4.76 on a scale from 1.00 (least positive) to 
5.00 (most positive). The majority of the STL participants considered the 
evaluation overview as the best part of the first session, and the classroom 
observations were the most popular part of the other sessions. The nieds 
expressed for future TA activities by the STL participants were varied, 
including requests for help in evaluation, dissemination, planning, and 
training. " 




of STL, presentations by the STL developer, and LEA project updates. In the 



/ 



203 




Teachers received information and training from a variety of sources, Wt 
mostly from school administrators and teachers. The largest proportion of the 
teachers indicated that they understood the model (80%) and that their 
teaching ability had improved as a result of their involvement with STL (50%). 

0 * 

Twenty-seven percent felt that their teaching ability had not changed. 

As mentioned previously, accurate implementation of the STL model 
involves five components. Thirty-three percent of the survey respondents 
indicated that thay carried out all six components, and no component was 
addressed by less than 76% of the teachers. The remaining components were 
addressed by at least 82% of the teachers. This degree of fidelity was not as 
high as expected. < . 

.. School systems . The impact of an innovation on a school system involves 
changes in practice or policy that affect or could affect more than a single 
school or single group of educators. Systemic impact included: 

• new teaching technique. (2 LEAs) 

• teacher enthusiasm (1 LEA) ' ^ 

• renewed confidence in county (1 LEA) 

• shared experiences with other schools (1 LEA) 

These results, while positive, do not indicate strong or lasting systemic 
changes. STL does not appear to have had an impact on district level policy 
or practice. This was probably influenced by the implementation strategies 
used and by the model, which is largely perceived as classroom contained. 

Central office staff. STL impacted on central office staff in two ways 
— awareness of a new teaching technique (3 LEAs). and , awareness of how well 
students can work together (J LEA). Neither impact gives any confidence that 
there were changes in skill or behaviSr by individual central office staff. 
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Schools. The impact of an innovation on a single school involved only 
those educators within that school. STL impact on single schools included: 

• teacher and stiident interest/enthusiasm (4 LEAs) , new 
teaching technique (3 LEAs) , cooperation between students 
and teachers (2 LEAs) 

time to develop curriculum (1 LEA) 

• cooperation between educators jtoward a common goal (2 LEAs), 
effective, inexpensive, easy to use and to train teachers to 
use, (2 LEAs) , networking among schools (1 LEA) 

• recognition (3 LEAs) 

The first group of results focuses on the model's impact on teachers 
and students and reflects the nature of STL's emphasis on cooperation. The 
second item and third gr^up of results focus on the process of implementation 
and is influenced by the SITIP design and by TA activities. "Recognition" 
reflects local and state acknowledge, publicity, and opportunity to network • 
with others ^in SITIP, and is influenced by MSDE initiatives and communication 
procedures. 

School administrators . School administrators felt that their involvemeht 
in STL enabled them to learn about a new teaching technique (3 LEAs), to share 
ideas with other professionals (1 LEA) , to become more aware of how well 
students can work together (1 LEA) , and to become more involved with students 
(1 LEA). Two responses indicate increased knowledge, and two (sharing ideas 
with profespionals and becoming involved with students) are more behavioral. 
cHowever, none are particularly strong, -suggesting again that STL is class- 
room centered. 

Cl assrooms and teachers . Impact on teachers fell into eight categories 
under the thiee general areas of; (1) increased knowledge, (2) improved 
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skills, and (3) strengthened attitudes/perceptions. (See Table 35.) In addi- 
tion, survey respondents assessed relative instructional value and impact on 
teachers in sjix areas, on a five-point Likert scale. (See Table 36.) 

Improved skills in a new teaching technique was the teacher impact 
category reported by all role groups across the largest number of LEAs. As 
can be seen in Table 35. survey respondents generally indicated that STL was a 
worthwhile, workable model, with mean responses ranging from 4.18 to 4.43 (on 
a scale from 1.00 least positive, to 5.00 most positive). They also believpd 
that teachers enjoyed STL and Increased their knowledge and skills (mean 
responses ranged from 4.06 to 4.17). However, these responses were not as 
high as the responses given for classroom impact. Teachers were consistently 
lower than the other role groups in their ratings of teacher Impact and 
instructional value. 

Students. The impacts of STL on students fell into 13 categories under ' 
the three general areas of : (1) improved attitudes or awareness. (2^ 
increased achievement, and (3) benefits from better instructions- (See 
Table 37.) Also. LEAs were asked to submit data summaries of cognitive and 
affective measures assessing STL's impact in terms of student achievement and 
attitudes. The results of these measures are also summarized in this section. 

Improved -attitudes about learning and school (e.g.. increased interest, 
cooperation, involvement, enthusiasm, motivation) was the most commonly 
reported category of student impact across all three^oTe groups. As can be\ 
seen in Table 36. survey respondents generally felt that student^^ enjoyed STL 
(4.37). that they were learning and achieving more (3.60 and 3.76. respec-' 
tively), and that their behavior was somewhat better/lt..ss disruptive (3.57 and 
3.65. respectively). Teachers tended to be lower in their ratings of student 
impact than other educators. 
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Table 35 



Impact on Teachers as Reported by Each Role Group: 
Student Team Learning, 1982-83 





Role Groups 
(Reported in No. of LEAs; 
N=9'> ' 


Impact on Teachers 


CO 


SA 


T 


As a result of STL teachers have: 








Increased knowledge 








- about teaching and learning through staff 
ueveiopinent/ observation ■ ^ 


'o 


1 


2 


imp r uvea SKIXXS * 








- in a new teaching technique. 

- in classroom management/organization, 
planning 

- in use of peer teaching 

- in working with students (e.g., motivation). 

- in assessing student progress/needs. 


3 

0 
0 
0 
2 


5 

3 
1 
0 
2 


7 

4 
0 
4 
4 


Strengthened attitudp.fi/perceptions 








^ - of how well students can work together. 
- about teaching (e.g., involvement, coopera- 
tion, sharing, satisfaction, recognition, 
and self esteem) . 


0 
2 


2 
1 


4 
6 



co-Central Office; SA=School Administrators; T=Teachers 
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Table 36 



Instructional Impact as Perceived by 
Survey Respondents: Student Team Learning, 1982-83 







Role 


Groups 




Impact on Instruction 


CO 
. N=9 


SA 
N=17 


T 

. N=63 


Total 
N=89 


Instructional Value 










Works In classroom. 

Is worth the work It takes. c . 
Is a worthwhile teaching approach. 


4.67 
4.33 
4.67 


4.75 
4.35 
4.76 


4.30 
4.11 
4.30 


4.42 
4.18 
4.43 


xui(jciL.i. uii xcdcners 










Teachers enjoy It. 

Teachers have Increased knowledge. 

Teachers have Increased skills.' 


1 4.33 
' 4.44 
4.44 


4.44 
4.37 
4.50 


4.08 
4.03 
3.89 


4.17 
4.14 
4.06 


Xmnact on StiiHpnt"c 










Students enjoy it. 
Students are less disruptive. 
Students' achievement has increased. 
Students are learning more. 
Students' general behavior is better. 


4.67 
3.89 
3.50 
3.56 
3.78 


4.75 
4.25 
3.94 
4.00 
3.00 


4.23 
3.46 
3.75 
3.51 
3.44 


4.37 
3.65 
3.76 
3.60 
3.57 


Time 










Teachers spend more time preparing students. 
Teachers cover curriculum in less time. 


3.78 
2.56 


3.56 
2.81 


4.05 
2.49 


3.93 
2.56 



CO-Centr^^^Offr^' ^1°" i'^^ (^^^""S^y disagree) .to 5.00 (strongly agree) 
co-Central Office; SA=School Administrators; T=Teachers . 
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Table 37 



Impact on Students as Reported by Each Role Group: 
Student Team Learning, 1982-83 



Impact on Students 



As a result of STL, students have: 
Improved attitudes or awareness 

- about their learning ability (e.g., increased 
confidence, higher expectations, success). 

- about learning -and...school^ increased 
interest, ccoperationT^lSvolvemei:^,,, enthusiasm, 
motivation) . 

Increased achievement 

- in retention of information. 

- in grades . 

- in test scores. 

- in general. 

- especially for under achievers/lower ability. 
Benefitt ed from better instruction which provides 

- variety. 

- peer tutorinr^/working in groups. 

- competition. 

- more complete instruction. 

- recognit:ion of success. 

- opport:anity to advance. 



Role Groups 
(Reported in No. of 
LEAs; N=9) 



CO 



2 
3 
2 
0 



1 
1 
0 
0 
1 
0 



■ SA° 



2 
3 
3 

1 . 



1 
0 
0 
0 
1 
0 



3 
4 
4 
2 
2 



1 
3 
1 
1 
1 
1 



CO=Central Office; SA=School Administrators;" T=Teachers 
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Affective measures of student impact were submitted by four of the nine 
LEAS (see Tables 38 and 39).* Baltimore, Dorchester, and Worcester counties 
administered the Student Questionnaire to students at the end of the implemen- 
tation period as a posttest. The questionnaire consists of seven questions 
or dimensions (i.e., recognition of differences, understanding of leSson, 
enjoyment of lesson, ease of lesson, learning of lesson, better grades, better 
lessons). Respondents answer using a five-point scale ranging from 1.00 (not 
at all) to 5.00 (yes a lot). The higher the score, the higher the agreement 
with the dimension being measured." There are elementary and secondary 
versions of the questionnaire. 

As can be seen in Table 38, mean responses averaged across the three LEAs 
ranged from a low of 3.78 (better grades) to a high of 4.65 (understanding of 
lesson). An examination of results within the three LEAs indicated that all 
mean responses • in Worcester County were between 4.03 and 5.00, inclusive. 
Mean responses in Baltimore and Dorchester counties were somewhat lower, 
ranging from 3.67 to 4.74. 

Charles County administered the Learning Environment Inventory (LEI) to 
100 students (50 STL and 50 control students) at Henson Middle School at the 
end of the implementation period (post). The LEI contains 105 items measuring 
15 dimensions. Eight dimensions were relevant for assessing model impact on 
student attitudes. Each is defined below: 

• Competitiveness— Students compete to see who can do the beat work. 

• Satisfaction— Stud >nts enjoy their class work. 

• Difficulty— The work of the class is difficult. 



* Montgomery Prince George's, Queen Anne's, and Washington counties did not 

Se^s-'^rce^ti'^'^-f "fT^'l '^T' ^"^'"^"^'^ ^ re.lTsutlrTAu, 
ceacners perceptions of student attitudes. 
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Table 38 



Student Attitudes (Student (juestionnaire) : Student Team Learning, 1982-83 



Dimensions 



I Recognition of differences. 

2. Understanding of lesson. 

3« Enjoyment of lesson, 
Ease of lesson. 

5. Learning of lesson. 

6. .Better grades. 
7' Better lessons. 




er the,score, the higher the agreement with the 
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• Friction—There are tensions amoung certain groups of students that 
tend to interfere with class activities 

i . - ■ 

• Dlsorgar.izatloh — The class. is disorganized. 

o A£aOx^FarrGr'i of the "class would mean little to individual 
members. 

• Favoritism— Certain students are favored more than the rest. 

• Environment— The books and equipment students need or want are 
easily available to them in the classroom. 

Students responded to items using a four-point scale ranging from 1.00 
(strongly disagree) to 4.00 (strongly agree) . The higher the score, the 
higher the agreement with the dimension being measured. High agreement is 
desirable for satisfaction and environment; for all other dimensions (except 
competitiveness) low scores are desirable. Competition may or may not be 
considered desirable depending on the philosophy of the school. As can be 
seen in Table 39, mean responses for STL students ranged from 2.21 
(favoritism) to 2.82 (environment). Mean responses for control students 
ranged from 2.48 (satisfaction and disorganization) to 2.80 (environment). 

A comparison of Charles County responses with the national test norms of 
• satisfaction-and environment, where high agreement (higher scores) is 
desirable, revealed that both STL and control responses were higher than test 
norms. Mean STL responses were found to be slightly higher than control 
responses on these dimensions. Of the remaining dimensions (except competi- 
tiveness) where lower scores are desirable, mean responses „ere lower than 
national norms for both STL and control students on difficulty and apathy. On 
.."apathy," the STL mean response was lower than the control mean response. On 
difficulty, the control mean response was slightly lower than the STL mean 
response. On friction, disorganization, and favoritism, however, STL and 
control mean scores were higher than the national norms. On all three of 
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Table 39 



Stuc'ent Attitudes ( Learning Environment Inventory ^: 
Student Team Learning, 1982-83 



Populations 
Dimensions* 


.National 
Test Norms 


STL 


Control 


X 


X 
N=50 


X 
N=50 


1. 


Competitiveness 


2.43 


2.58 


2.51 


2. 


Satisfaction 


2.40 - 


2.56 


2.48 


3. 


Difficulty 


2.67 


2.55 


2.51 


4. 


Friction 


■ 2.40 


2.66 


2.74 


5. 


Disorganization 


2.35 


2.37 : 


2.48 


6. 


Apathy 


2.54 


2.47 


2.51 


7. 


Favoritism 


2.03 


2.21 


2.54 


6, 


Environment 


2.40 


2.82 


- 2.80 



SeI)'''^ThrMr'%r''^''' froma.OO (strongly. disagree) to 4.00 (strongly 
mfasui;d. ^ the agreement with the dimension 

ir:L"drLri969?''' °" '''' '^'^^'^^^ ^^^^^^^ ^ -^j-. 

* desirable for satisfaction and environment; f or all ■ 

other dimensions except competitiveness, low scores are desirable 

pSolo^^Tof^thrLho^r ^"^"^^^ ^p- 
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these dimensions, STL mean scores were lower than control mean scores. These 
results indicate that STL appears to have had a positive affective impact on 
students. 

Calvert County, which did not submit any of the standardized affective 
measures of student impact, did return a summarr statement compiled by two 
t.iachers using the STL strategy at one middle school. Their report concluded, 
"As a result of the Student Team Learning strategy, an increase was shown in 
student. . .behavior and self-esteem." 

Cognitive measures of student impact were submitted by three out of the 
nine LEAs implementing Student Team Learning : Charles .. Dorchester , and 
Montgomery counties.* 

o 

Charles County reported student grades on teacher-made criterion- 
referenced tests in the following subject areas: math, science, language 
arts, and social .studies. These tests evaluated student achievement after 
completion of a two to five week unit of study in the specified subject area. 
Table 40 reports percentages of students with grades of "C" or above for 
students exposed to the STL technique (experimental group) as well students 
in non-STL (control group) classes. In five out of eight STL classes, a 
higher, percentage of STL students earned grades - of "C" and above than the 
percentkge of students in non-STL classes. Of special interest is the fact 
that below average STL students consistently demonstrated higher grades than 
below average or average non-STL students. This provides additional support 
for the notion that STL is particularly effective for below average students. 



While CAT scores for the STL students in Montgomery Village Jr. High for 
October 1982 were submitted by Montgomery County, they are not discussed 
here^since no related data (e.g., post scores, trend analysis) were - 
provided. ^ ' , 
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Table 40 



/ Grades,, on Crlterlon-Jlef erenced Tests: 

I Charles County, Student Team Learning, 1982^83 



r ' — — 

\\ • ■ 


"C" and Above 

% 


Below "C" 

% 


6th Grade Math 

STL (Avg.) 
Control (Avg,) 


70 

72 , . 


30 
28 


i6th Grade Math 

STL (Avg,-) 
Control (Avg,-) 


92 
82 


8 


8th Grade Math 

STL (Avg,-) 
Control (Avg,) 


92 
71 


^^ 8 

29 


8th Grade Math 

STL (Avg,--) 
Control (Avg,) 


. 85 
83 


15 
17 


7th Grade Science 
STL (Mix) 
Control (Mix) 


• 73 
79 


27 
21 


8th Grade Language Arts 
STL . (Avg,) 
Control (Avg.+) 


97 
100 


3 
0 


6th Grade Social Studies 
STL . (Mix) 
Control (Mix).. 


89 ' 
81 


11 
19 


6th Grade Social Studies 
.STL (Avg.) 
Control (Avg.) 


100 
80 


0 
20 



Student Ability Grouping 

Avg.+ = Above average Avg.= Average 

Avg.- = Below average Mix = Heteroge 
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Dorchester County also reported student grades on a teacher-made 
criterion-referenced social studies test. Two fifth grade classes were pre- 
and posttested on the teacher made test. One class was exposed to the STl, 
Jigsaw approach (experimental^^ for one month at the end of the year. The 
other class was provided instruction in a regular teacher directed manner 
(control). Table 41 presents the percentage of students scoring "C" or 
above on each of the tests. 



Table 41 

Grades on a Criteriori-Ref erenced Test: Dorchester County, 
Student Team Learning, 1982-83 





STL class 


Control class 




% "C" or above 


% "C" or above 


Pretest ■ 


47% 


42% 


Posttest 


90% 


69% .. 









, The results presented in the table above indicate that both classes were 
fairly equal at the tike of the pretest. However, at the time of the post- 
test, 90% of the STL students scored "C" or better compared with only 69% of 
the control class students. ' STL students earned higher grades than students 
instru^cted in the regular teacher directed manner. 

Direct "cause and effect" claims for STL impact on student achievement 
cannot be made on the basis of the above data or on the^ test designs used. 
However, for two of the LEAs reporting cognitive data, m_any students have 
mastered the material and this can be attributed in part to STL. 
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Participant Concerns 

Chart 6 lists the concerns reported by STL Implementers. All of the ' 
concerns were model specific and were related to the amount of time required, 
the scoring system, the model's effectiveness with different kinds of 
students, discipline, and the availability of materials. The largest number 
of LEAs reported time concerns. 

Chart 7 lists the recommendations/solutions reported by STL implementers. 
These recommendations were divided into four general areas: implementation/ 
preparation, involvement, expansion, and external assistance. The largest 
number of LEAs made recommendations in the areas of implementation/preparation 
and expansions Very faw of the recommendations were solutions for the 
concerns stated. Six out of the nine STL LEAs recommended expansion even 
though educators within those LEAs expressed concerns about the model. 
Summary and Conclusions 

In the preceding pages each research question or issue has been addressed 
and the findings have been discussed across LEAs. Here, some general conclu- 
sions across issues and LEAs are reviewed. Then, activities are summarized 
for each LEA.* ^ 

It is apparent that STL is perceived aa a classroom-focused teaching 
strategy that iMivi^dual teachers can implement easily.'once they have received 
training and have obtained or developed suitable materials. "Successful- 
teachers, familiar with their courses, students, and the STL strategies, used 



* oroth.f """^ provided more documentation 

or other evidence of model implementation. 
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Chart 6 

Concerns/Problems Reported: Student Tea. Learning. 1982-83 



Requires too much timp/pffnrf i ^ / 
requires too much paperwork (2) ■ ■ 

* ^» m a, 

Holds back vadeiDically talented (2) ■ • ' 

Wea er students, depend on stronger ones (1) 

™ to handle absentees (1) ■ 

Discipline - tendency to "goof off" Ipqc t^,X 

.1 soor Off , less teacher control, increased noise level 

Availability of material correlated to county currlculuMl) • ■ 



figures in parenthesis indicate the number of LEAs .akin. > 

ui liMS Diaicin^ a given statement. 



Chart 1 ■ 
Recommendations/Solutions: Student Team Learning. 1982-83* 



Implementation/preparation 

Allow more time for classroom observations (1) 

Provide, bulletin boards for publicizing team scores (1) 

Provide more workshops on unit development (1) 

provide more opportunity for unit preparation (1) 

Reduce burden on teachers (2) 
-Use earlier in year (1) ' 
X Make research results available to educators before implementation (1) 
Involvement 



Have only voluntary participation (2) 

Encourage teachers to increase their knowledge and skills (1) 

Expans ion ^ 

T \ 



Use by all instructors (1) 
Increase numbers involved (5) 
District provision of follow-up assistance (1) 



External assiistance 



MSDE should - develop materials for business education (1) 

- provide continued support (1) 

- provide more funding for materials and dissemination (1) 



* Figures in parentheses indicate the number of LEAs^ making a given statement 
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one or, two units with high fidelity (quality rather than quantity of implemen 
tation). Its subjective value was high: teachers liked using at least one o 
the three approaches offered, and administrators approved o£ teachers having 
access to a model like STL. 

Impact was made on student achievement in specific units of instruction 
where teachers had suitable materials and paid attention to implementing al] 
relevant components faithfully.. Casual grouping ofj students or use of STL fo, 
units. that did not readily f|it STL guidelines result in little impact differ- 
ence from "regular" instruction. However, student attitudes about the 
lessons, their self-esteem, and willingness to work with- others increased 
during implementation of/ STL, 

1 - ' ' ■ ■ ■ 

Impact was ma^e on teachers' knowledge (of strategies) through training, 
and on skills and attitudes through trial implementation. Early successes 
encouraged further use (of a given unit or set of materials) . However, most 
teachers using STL properly did so for only one or two units a year-partly 
because of the demands of pretesting for grouping and partly because suitable 
materials were nod available for more units (and there appears to be no 
^release time for development). 

Impact was made on a school when the principal actively encouraged many 
teachers to use at least one STL strategy. School and central office impact 
was primarily awareness of STL strategies and of the benefits of peer learning 
for students. Whiie interaction through training encouraged cooperation, 
apparently there were no systemic effects. 

Tl.e strategies to' provide interactive support (within a given t^a) were 
important, but less so than for the other three SITIP models. This reflected 
the fact that all nine LEAs (regardless of the implementation strategy stated 
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in their plans) essentially expected teachers to use STL voluntarily once they 

were trained. Pc\sitive impact (fidelity and scope of use by an enthusiastic 

teacher) was made when quality training was provided and was directly 

supported by suitable materials (or development time) and follow-up, on-site 

assistance and recognition; when central office staff clearly communicated " 

their interest in the success of STL and made sure^that resources (were 

available to carry out plans; and when principals expected and acknowledged 

fidelity implementation. Positive impact was reduced or barriers created 

when: initial plans were overly ambitious; project leaders did not carry out 

key steps of their plans; there were not enough local trainers or teachers as 

trainers could not spend enough time in that role; there was heavy reliance on 

training alone, without provision for on-site help as teachers b^gan trial 

runs; teachers, left, alone, modified STL components or developed materials 

which did not reflect STL philosophy and therefore did not achieve! expected 

„ ' ' ' ■' ■„.. I ' ■ ' i ' 

results; and when communication between "levels" (especially from bentral 

office) was unclear or delayed. 1 

In the following case reports of the nine LEAs implementing STL, atten- 
tion is given to the influential factors mentioned above and also to specific 

c. 

objectives and results achieved at each site. 

"^O^^^^"*"^^ Baltimore County has been implementing STL for two 

years using a pilot district strategy. In September 1982, those involved in 
the project "hoped" to inform and train local educators and had "partly 
achieved" their dissemination plans for the 1982-83 school year. In June 
1983, educators had "partly achieved" their information/training objective. 
The status of the 1982-83 dissemination plans was not specified. In addition 
to the three objectives mentioned in September, educators in June had 
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"achieved" improvement in students' involvement in learning and had "partly 
achieved" the remaining five objectives specified in Table 30. A new objec- 
tive, evaluating the usefulness of STL as a teaching strategy had also been 
"partly achieved". 

• Scope and intensity .. After the first year of STL implementa- 
• tion (June 1982). STL was being implemented m one elementary 

and one middle school with approximately seven teachers and 
250. students in reading/ language arts, mathematics, science, 
and social studies. Little changed in the 1982-83 school 
year, student Team Achievement Divisions (STAD) was the most 
popular STL strategy. 

• Fidelity . In Baltimore County the survey respondent addressed 
all components of the STL model. He/she felt that shared 
responsibility for and effort toward team success, the 
cooperation among team members, and peer tutoring were the 
aspects of STL having the greatest impact on students. 

• Time. Educators spent an average-of 9 months involved in 
SITIP, across the 1982-83 school year. Teachers reported ' 
spending an average of 10% of their school week on STL-related 
activities. School administrators and central office staff 
reported that STL required teachers to spend more time 
preparingostudents (e.g.; grouping, pre-testing) but teachers 
disagreed. All role ^groups reported that curriculum coverage 
took longer for STL. ^ 

School administrators spent an average of 10 days and central 
ottice staff* spent an average of 35 days on SITIP. School 
administrators reported that SITIP took "substantially more" 
time^^and energy while central office staff report "about the 
same amount of time and energy compared to similar previous 
projects. " ' 

• Roles and responsibilities . School administrators" and central 
office staff combined spent the least amount of time and 
energy on evaluation (2.00)** and fhe most effort on 
supporting school implementation (4.50). School administra- ■ 
tors devoted the least effort to administration and evaluation 
Ci.OO) and the most to supporting school implementation and 
dissemination (5 00) . Central office staff spent ."some" time 
and energy (3.00) on materials development, dissemination, and 
evaluation and "quite a lot" of effort on administration 
inservice, and supporting school implementation. 



* Central office staff were also involved in another model. / 
" 5r^o\rgr1frdeiJ)?^ ^"^^^^^ °" ^ 0 (none) to 
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Teachers reported that most of the training was done by 
developers. Educators rated the interactive support received 
by the five role groups involved in STL as good to excellent 
Developers received the lowest ratings and teachers the 
highest. By June 1983, information related' to STL had been 
received by about 12% of the central office staff and by 25% of 
the other educators in the district. Training and help had 

f "i^ed by none of the central office staff a^idby about 
LIA of the school administrators and teachers. Other facultv 
had received some training (12%), but no help . 

• . Impact . STL has had an impact on training and on the schools 
educators, and students involved. In the area of training ' 
teachers felt they know a great deal about the modiE 

An example of school-wide impact is the use of STL to integrate 

and orient new sixth graders into the middle school. School 

administrators felt that STL involvement enabled them to shar e 

ideas with other educators. lem co snare 

Educators indicated that STL has had an impact at the classr oom 

ievel (e.g., STL is a worthwhile, workable instructional 

model). The classroom impact of STL was related to the use of 
peer tutoring, competition, more complete instruction, recogni- 
tion of success, opportunity to advance, and variety. Teachers 

improved their skills in a new teaching tec^"S?^ue and — 

strengthened their attitudes/perceptions about teaching. 
Increased student achievement was perceived by educators and 
evidenced in better retention of information, in grades, and 
in test scores. 

Affective studjKit impact was also perceived by educators and 
i^idenced in/better/less disruptive behavior, improved atS- 
.PVPn yarning and school, and positive responses on the 

^ ?ion of H^f? ' the Student Questionnaire (i.e., recogni- 
tion of differences, understanding of lessons, enjoyment of 
lessons, ease of lessons, learning of lessons, better grades 
and better lessons) . o 

• Participant Concerns. Educators felt that STL could hold back 
the academically talented and that the bumping system in TCT 
could could damage student self-esteem. Expansion was 
recommended for the 1983-84 school year, however. 

Factors influencing the relative success of STL included: 1) central 

office support, which was good, although it was somewhat reduced toward the 

end of the year when policy decisions resulted in greater attention to another 

SITIP model (mastery learning) in the county;. 2) some initial lack of focused 

energy due to organizational changes in the school; 3) strong teacher interest 
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and approval of STL as a set of useful teaching techniques. Together, these 
factors suggest that -teachers will continue to use STL at the pilot sitfes, but 
will probably need some recognition (at least by school based administrators) 
of their efforts, if /sTL is to expand, more central office support will be 
needed^. JEducators may wish to review which of the STL strategies is most 
appropriate for a given subject or unit and grasp of students, and consider" 

trying alternative strategies. - - — 

Calvert County . Calvert has been implementing STL for two years using a 
lighthouse school- strategy. In September 1982. educators had "partly 
achieved" three of the nine objectives specified in Table 30 (i.e., informing 
local educators about the model, training local educators to use the model, 
and ensuring a match between instruction, curriculum, and tests). The 
remaining six objectives were "hoped for." In June 1983. twa objectives were 
"achieved" (i.e., improving teachers' classroom competence and insuring 
curriculum alignment), one was still "hoped f6r" (i.e.. improving student 
achievement in other subjects), one was not given a status (improving tlme- 
on-task) and the remaining five were "partly achieved." 

• Scope and intensity. After the first year of STL implementa- 
tion (June 1982). STL was being implemented in one middle 
school by three teachers with 66 students in reading/language 
arts and social studies. By June 1983. two elementary schools 
were also involved. Teji teachers and 300 students were using 
STL in a variety of subject areas. Student Team-Achievement 
Divisions (STAD) and Teams-Games-Tournaments (TGT) were the 
most popular STL strategies. 

• Fidelity . The STL components least consistently addressed by 
the teachers were relating quiz/tournament scores to indivi- 
dual 'and team achievement and using peer tutoring. Most of 
the: teachers felt that the competition and shared responsibi- 
lity for team success were the aspects of STL having the 
greatest impact on students. 
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» T.-Te. Educators spent an average of 9 months involved in STL 
a jss the 1982-83 school year. Teachers reported spending an 

rage^^of 19% 'of their school- week on STL-related activities 
t . required teachers to spend more time preparing students 
(e.g., grouping, pre-testing) and allowed less time for 
curriculum coverage. 

School administrators spent an average of 12 days on SITIP 
They felt that SITIP took about the same amount of time and 
energy as similar previous projects while central office staff 
reported "slightly more." 

Roles and Responsibilities. School administrators and central 
office staff combined spent the least time and energy on 
materials development (2.60)* and the most on dissemination 
(J.ao;. School administrators spent the least time on 
administration and materials development (2.50) and the most 
effort on dissemination (3.50). Central office staff spent 
most of their time on. administration and supporting school 
implementation and dissemination (5.00), and the least time on 
materials development (3.00). ' 

Most of the training came from the developer and from school 
sta^f (teachers and principals). Educators rated the inter- 
active support received from the five role groups involved in 
SITIP as above average. Central office staff received the 
lowest and teachers and school administrators received the 
highest rating of support. By the beginning of June 1983, 
Information on STL had been received by 75% of the central 
office staff , 50% of the school administrators, and 25% of all 
other faculty. Training; and hel£ had been received by 2$% of 
central office staff, school administrators, and teachers. 

Imgact. STL has had an impact on training and on the schools, 
educators, and students involved. In the area of training, 
teachers felt that they understood the model and t hat their 
wlth^STL ^^^^^"^ improved as a result of their involvement 

The schools Involved in STL have benefitted from the Increased 
cooperation between students and teachers. 

Central of fice staff and school administrators felt that 
involvement with the SITIP project enabled them to learn about 
a new teaching technique. . School administrato rs also became 
more involved with the students. ' 

Educators indicated that STL has had an impact at the class- 
room level (e.g. STL is a worthwhile, workable instru^Ei^al 
model) . They felt that iSTL helped provide variety to the 
instructional routine. , 



* Cfgreat dffj)" ^''"^ '"'^^^'^ °" " -^^^ ^-"^ « (none) to'5.00 
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Teachers increased their knowledge about teaching and learning 
and improved their skills in a new teaching technique and in 
classroom management/organization/planning. They strengthened 
their attitudes/perceptions-of how well students qan work 
together and about teaching. 

Increased student achievement was perceived by educators and 
evidenced in test scores. 

Affective student impact was perceived in terms of better, ' 
less disruptive behavior and improved attitudes about l&arnin« 
and school. * 

, • Participant Concerns. . Educators felt that STL required too 
much paper work. Suggested changes/recommendations included 
encouraging teachers to increase their knowledge and skills, 
and expansion to other classes of schools. 

Factors influencing relative success of the project include: 1) the 
interest and support of school-based administrators, and 2) the value of STL 
as, perceived by teachers, staff changes at the central office do not appear 
to have had a negative impact on the project, since school staff carried out 
most of the necessary tasks. The. availability of STL developers was helpfql 
in training teachers in the ^lementary "feeder" schools. Educators may wish^ 
to decide if the project is district wide or school based and then make 
expansion plans with appropriate support. 

Charles County . Charles has been implementing STL for two years using 
a lighthouse school strategy. In September 1982, educators "hoped"' to achieve 
five of the nine objectives specified in Table 30 (i.e., improving student ^ 
achievement in basic skills, informing local educators about the model, 
training loc^l educators to use the model, improving teachers' classroom 
competence, and improving students' involvement in, learning) . In' June 1983, 
two of these objectives (improving teachers' classroom competence and 
improving students' involvement in learning) were "partly achieved" and the 
other three were "achieved".' One additional objective not specified in - 
September (helping teachers become better organized) was "partly achieved" in 
June . . _ . * ^ , 

■ - . ' " 245 ,^ ' 

226 



• Scope and intensity. After the first year of STL implementa.- 
tion (June 198?), STL was being implemented in one middle 
school with 17 teachers and 500 students in reading/language 
arts, mathematics, science, and social studies. In June 1983, 
over 10 elementary and junior/middle schools were involved as' 
teachers voluntarily implemented STL following local inser- 
vice. Student Team-Achievement Division (STAD) and Teams- 
Games-Tournaments (TGT) were the most popular STL strategies.' 

• Fidelity. The STL component most consistently addressed by 
the teachers was: "quiz/tournament scbrfes related to indivi- 
dual and team achievement." The components least addressed 
were peer tutoring ana use of appropriate materials. Most of 
the teachers felt that team recognition was the aspect of STL 
having the greatest impact on students. 

• Time. Educators spent an average of 6 months involved in STL 
across the 1982-83 school year. Teachers reported spending an 
average of 26% of their school week on STL-related activities 
STL required teachers to spend slightly more time preparing 
students (e.g., grouping, pre-testing) . Educators were unsurp 
whether STL allowed more time for curriculum coverage. 

Central office staff spent ah average of two days on STL. 
School administrators reported that STL took "slightly more" 
time and energy while central office reported "about the same" 
amount of effort on STT.. in comparison to similar nrevious 
projects. 

• Rol es and responsibilities . School administrators and central 
office staff combined spent the least time and energy on 
materials development (1.33)* and the most effort -on inservice 
and dissemination (3.67). Central office staff spent "v»ry 
little time on materials development (1.50) and "quite a lot" 
of energy on inservices and dissemination (4.00). School 
administrators also spent little of their time on materials 
developmenf (1.00), and the most amount of time on administra- 
tion (4.00), 

Most of the training was done by school administrators and 
teachers, although some teachers received information/training 
from developers, MSDE, and central office staff. 

A team of four teachers is in charge of staff development, 
which consists of an awareness session, six-hours of inser- 
vice, and follow-up by the team members. At the pilot middle 
school, department heads, serve as resource people. Educators 
gave the highest interactive support to teachers and school 
administrators (4.26 and 4.21 — good to excellent) . All rcle 
groups received above average ratings. MSDE and central^^ 
office staff received the lowest ratings. By the beginning of 



* (Hreft dff?)'/i^"°" '""'^^ °" ' ^'^^"^^ 0 (-°-) to 5.00 
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June 1983, all school administrators, 75% of the central . 
office staff, and 50% of the teachers had received inf ormatio n 
about STL. Training had been received by 75% of the central 
office staff and 50% of the teachers and school administrators 
(all schools have at least one teacher trained). Help has 
been received by 25% of the educators involved. 

ISEact. STL has had an impact on training, on the district in 
general, and on the schools, educators, and students involved. 
In the area of training , all of the teachers indicated that 
they understood the model and several felt that their teaching 
ability had improved as a result of their involvement. 

The schools have-benefitted in terms of increased cooperation 
and enthusiasm among teachers and students, recognition, and 
an effective-, inexpensive staff development program. Central 
office staff felt that STL involvement enabled them to" learn a 
new teaching strategy. 

Classroom level impact (e.g. STL ±s a worthwhile, workable 
Instructional model) was perceived by educators and has Been ' 
attributed to some extent to the use of peer tutoring. 

^^^^^^^^ increased their knowledge about teaching and learning 



and improved their skills in a new, teaching technique, in 
classroom managefflent/organlzation/planning, in working with 
students, and in assessing student progress/needs. They have 
strengthened their attitudes/perceptions of how well students 
can work together and about teaching. 

Increased student achievement was perceived by educators and 
evidenced in grades on teacher made criterion-referenced 
^Vll: In five out of eight STL classes, a higher percentage 
of STL students earned grades of "c" and above thai^ non-STI 
students. Increases in student achievement were especially 
evident for below average students using STL. 

Affective student impact was perceived in terms of improved 
attitudes about their learning capabilities and about learning 
and school in general. Educators were not sure about whether 
behavior/discipline had improved. On the LEI, STL students 
had higher scores than control students on competitiveness 
satisfaction, difficulty, and environment and lower scores'on 
friction, disorganization, apathy, and favoritism. 

Participant Concerns. Educators felt that SJL^required too 
much paperwork and too much time/effort on planning and pre- 
paration. One teacher did not like the STAD scoring system. 
Other concerns included the lack of materials correlated to 
the county s curriculutu, the difficulty which remedial 
students had in order to stay on task, how to handle absen- 
tees, and the increased noise levels and reduced teacher 
contror during STL classes. Suggested changes/recommendations 
teii into the categories of implementation—preparation (e g 
increase the numbers involved and provide follow-up assist- 
ance) . " 
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Factors influencing relative success of the project include: 1) the 
strong leadership and support of the principal. 2) the teacheribased training . 
and related activities to involve .educators beyond the pilot school, 3) the 
value of STL as perceived by teachers, and 4) evidence (grades and student 
surveys) that students benefit from STL. However, as attention focused on 
expansion through training, some model-specific concerns arose wiich educators 
may need to address for some classes. 

Dorchester County. Dorchester has been implementing STL for one year 
using a pilot district strategy. By June 1983. educators had "partly achieved" 
improvement of student achievement and had "achieved" four I additional objec- 
tives (informing local educators, training educators to useVthe model, 
improving teachers' classroom competence, and improving time^-task) . 

• Scope and intensity. After the first year of implementation 
(June 1983). STL was being implemented . in all seven elemehtary 
schools by eight teachers and 177 students in social studies. 
Jigsaw was the most popular STL strategy. 

• Fidelity. The STL components most consistently addressed by \ 
teachers were the mix of students on each team and the exten- \ 
sive use of peer tutoring. The component least addressed was \ 
' quiz/ tournament scores relate to individual and team achieve- 
ment. The largest number of teachers indicated that shared 
responsibility for team success was the aspect of STL having 

the greatest impact on students. 

• Time. Educators spent an average of 4 months involved in STL 
across the 1982-83 school year. Teachers reported spending an 
„average of 14% of their school week on STL-related activities 
STL required teachers to spend slightly more time preparing 
students (e.g.. grouping, pretesting). Educators were unsure 
whether STL allowed more time for curriculum coverage. 

School administrators spent an average of three days on STL. 
Central office staff reported that STL took "substantially 
more time and energy, whli- school administrators reported 

about the same" level of „rt spent on STL in comparison lo 
similar previous projects. 
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' Roles and responsibilities . School administrators and central 
. office staff combined spent the most time and energy on 
supporting school implementation (2.44)* and the least effort 
on administration and dissemination (.75), Central office 
staff spent the most effort on materials development (4.00) 
and the least effort on dissemination (1.00). School adminis- 

""""^^ 0?^" """^^ °^ ^^^^"^ ^^"^^ supporting school implementa- 
tion (.2.37) and the least time on administration (.43), 

Most of the training was done by MSDE and central office staff 
although some teachers were trained or received information 
from the developer and from school administrators and 
teachers. Educators rated the interactive support received 
from these role groups as above average. Central office staff 
received the highest ratings, and developers and teachers the 
lowest. By the beginning of June 1983, information about STL 
had been received by all school administrators , bv of the 
central office staff, and by 25% of the teachers. Training 
had been given to 25% of the central office staff and teachers 
and by less than 25% of the school administrators. Help had 
been given to 25% of the teachers. 

ISEact. STL has had an impact on training, on the school 
system, and on the schools, educators, and students involved. 
In the area of training, the majority of the teachers reported 
that they understood the model and that their teaching ability 
had improved as a -result of their involvement fifty percent of 
the teachers felt they needed to learn more about STL. 

The school system benefitted from teacher enthusiasm. At the 
school level, educators and students benefitted from a new 

teaching technique, increased networking among educators, and 

teacher and student enthusiasm. 

Central o ffice staff and school administrators felt that 
involvement in SITIE made thejn more aware of how well students 
can work together. 

Educators indicated that STL has l^ad an impact at the class- 
room level (e.g.. STL is a worthwhile, workable instru^^HS^Tal 
model). Teachers improved their skills in a new teaching 
technique, in the use of peer tutoring, and in working with 
students. They strengthened their attitudes/perceptions of 
how well students can work together and about teaching. 

Educators were unsure as to whether STL had increased student 
achievement since teachers implemented the, model for only a 
short period of time. A significantly higher percentage of 
fifth grade students scored a "C" or above on a teacher-made 
criterion-referenced test than a comparable group of studencs 
not using STL. 



* jfgr'eat de"?)' '"'^'^^ ''^^ °" ^ ^^^^^ ' ) ^° 5.00 
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Affective student impact was perceived by educators in terms 
of improved attitudes about, learning and school, and by some- 
what less disruptive behavior. - Students responding to the 
Student Questionnaire gave positive responses to all seven 
dimensions (i.e., recognition of differences, understanding of 
lessons, enjoyment of lessons, ease of lessons, learning of 
lessons, better grades, and better lessons). 

• Participant Concerns. Educators were concerned about the time 
required for planning/preparation and the tendency 6f we^er- 
ability students to depend upon stronger-ability students. 
Recoimmended changes fell into the categories of implementa- 
tion/preparation (e.g., more opportunity to pre-plan units, 
use earlier in the year) and -expansion (e.g.", increase numbers 
involved) . • 

Factors influencing relative success include: 1) planning, communica- 
tion, decision-making, and training were carried out thoughtfully with good 
cross-hierarchical participation, and 2) educators' enthusiasm (which probably 
influenced classroom use and positive student reaction). The project has 
begun well with enough schools involved to provide a supportive network for 
teachers. Educators may need to review progress and distribute resources 
(including teachers' energy) to address the immediate classroom concerns of 
current implementers (e.g., for materials development) and 'also the interests 
of others wishing to be trained. ' . 

Montgomery County. Montgomery has been implementing STL for. two years 
using a lighthouse school strategy. In Sep-tember 1982, educators "hoped" to 
improve student achievement in the basic skills, inform local educators about 
the model, and improve students' involvement in learning. They had "partly „ 
achieved" improving teachers'" classroom competence and had "achieved" curric- 
ulum alignment and training educators to use the model. In June 1983, three 
ob:?2ctives we^e "achieved" (curriculum alignment, helping teachers become 
better organized, and improving students' involvement in learning). One 
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objective was no longer applicable (informing local educators aboi)t themodel) 
and the remaining five objectives were "partly achieved." (See Table 30.) 

• f"f^,^"'^^? Jltjr. After the first year of implementation 
(June 1982), STL was being implemented in one junior high by 
approximately nine teachers and 2-50 students in a variety of 
subjects. In June 1983, 480 students were using STL. Student' 

Division (STAD) and Teams-Games-Tournaments 
, ^TGT) were the most popular STL strategies. 

• Fidelity. The STL component not addressed by all of the 
teachers was the extensive use of peer tutoring. Teachers 
indicated that competition and team recognition were the 
aspects of STL having the greatest impact on students. 

• li^e. Educators spent an average of three months involved in 
STL across the 1982-83 school year. Teachers reported 
spending an average ..of 28% of their school week on STL-related 
activities. STL required teachers to spend more time 
preparing ^students (e.g., grouping, pretesting) and allowed 
less time for curriculum coverage. School administrators 
spent an average of four days on STL. STL took "substantially 
less time and energy than similar previous projects. 

• . Roles and responsibilities. School administrators and central 

office staff spent the least amount of time and energy on 
materials development (.50)* and the most effort on adminis- 
tration (2.50). Central office staff spent the least time on 
evaxuation vO) and the most effort on dissemination (3.00). 
The school administrator spent most of his/her effort on 
administration (3.00) and the least effort on materials 
development (0) . 

Most of the training was done by MSDE, although some teachers 

also received training/ information from the developer and from 

school administrators and teachers. Ratings of interactive 

support from the role groups involved in SITIP were average or 

above except for the ratings of central office staff support 

given by school administrators and teachers. Teache'rs and 

school administrators received the highest ratings and central 

office staff the lowest. By the beginning of June 1983, 

information about STL had been received by 50% of the^teachers 

and training had been given to 25% of the teachers at th^ 

pilot school. • 



* cTgrel tifa") . '"'^'"^ rated on a scale from 0 (none) to 5.00 

251 



232 



• Impact. STL has had an impact on training and on the school, 
educators, and students involved. In the area^of training , 
the majority of teachers felt that they understood a great 
deal about the model. 

At the school level , educators and students benefitted from a 
new teaching technique and teacher interest and enthusiasm. 
Central o ffice staff felt that involvement in SITIP enabled 
them to learn about a: new teaching technique. 

Educators indicated that STL has had an impact at the class- 
room level (e.g., STL is a worthwhile, workable' instructional 
model) in terms of the use of peer tutoring, competition, more 
complete instruction, an^ of success. .. 

Teachers increased their knowledge about teaching and learning 
and improved their skills in a new teaching technique, in 
classroom management/organization/planning, and in assessing 
student progress/needs. They also strengthened their 
attitudes/perceptions about teaching. 

Increased student achievement was perceived by educators and 
evidenced in grades. During the 1981-82 school year, STL was ' 
^ being used with students performing one year below grade 

.• level. In 1982-83, above average students were also included. 
Ajfsctive student impact was perceived in terms of improved 
attitudes about their learning capabilities and about learning 
and school in general. Educators were unsure whether behavior 
was better as a result of STL. 

• Participa nt Concerns . Educators were concerned about the time ' 
required to implement ~ STL. Recommended changes fell into the 
categories of implementation/preparation (e.g., reduce the 
burden on teachers) and expansion (e.g., increase number of 
teachers involved) . 

Factors influencing relative success include: ]) teachers' knowledge of 
STL and interest in using it, and 2). educators ' perceptions that STL benefits 
students. However, there appears to be little impact of STL outside the 
Immediate classroom which suggests that it is a technique used at a teacher's 
discretion (an average of 28% time over three months). Educators may wish to 
determine how to maintain at lei xevel of use, bearing ^an " 

some teachers feel "burdened." 
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Prince George's cUry.* Prince George's has been implementing STL for' 



two years using a capacity building strategy. In September 1982. educators 
"hoped" to train educators to use the model and improve students' involve- 
ment in learning (motivaWon) . They had "partly achieved",.two objectives- 
improving student achievement in basic skills and informing local educators 
about the model. Prince iorge's County did not indicate the status of their 
obj ective s in June 1983. \ 



After the first year of\ implementation (June 1982), STL was being 
implemented across the three yeas of the county in approximately 16 schools 
of all types with 21 teachers knd 1.500 students in reading/ language arts 
and science.** m June 1983. approximately 30 teachers were using STL. 

'Teachers improved their skills in assessing student progress/needs, and 
students improved their attitudes about learning and school. Administrators 
'considered STL to be a useful teaching technique, but^'^ad higher priorities 
for the allocation of resources for the 1983-84 school year, it appears to 
have become an "underground project." approved by the central office but not 
centrally managed or supported. The primary cause for the change in status 
was competition for scarce resources. 

Queen Anne's County' Queen Anne's has been implementing STL for two 
•years using a capacity building strategy, m September 1982. educators* 
"hoped" to improve student achievement i„ th^ ba.lc skills and in other 



l^^^f ' " in Prince George's County did not respond to the 1983 General 
Survey so many of the questions addressed by the evaluation report cannot 
County is\;.ed ' implementation in Prince Jeo'ge' 

S^pte^be? ?982?."'" Questionnarf 

" ItlTs a'"fsuU^f°s?T^%'"since%r°^^ '^^^"^'^^ implementation of 
. to the Sl"p p^ojfct! ""'''^ been using the program prior 



to the SITIP project. 
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objects and had "partly achieved" three objectives (helping teachers become 
better organized, improving time-on-task, and improving students' involvement 
in learning) . 

o 

The remaining four objectives specified in Table 30 were already 
"achieved." In June 1983, only two objectives were "achieved" (i.e.. 
Informing local educators about the model and improving students' involvement 
_ in learning) . , Tw^oMec_tlves^ere,dropped-^improving student achievement in 
basic skills and ensuring curriculum alignment. The remaining five objectives 
were "partly achieved." 

• f^T fopo^"'^""'"^^- ^^'^^^ '^^^ ^i"*: year of implementation 
Uune 1982), STL was being used in one high school with 23 
teathers and 500 students in a wide range of subject areas. 
ll.iT%rl?* 900- students were involved. Teams-Games-Tourna- 
ments (TGT) and Student Team-Achievement Divisions (STAD) were 
the most popular STL strategies. 

• Fidelity . The STL component most consistently addressed bv 
teachers was including a mix of students on each team. The 
component least addressed was the pubiici7.ing of successes. 

^ ine otner components were addressed by 73% to 91% of the 

educators. The largest number of teachers reported that the 

shared responsibility for team success was the aspect of STL 
having the greatest impact on students. 

• Up-' ^'^"^ators spent an average of three months involved in 
STL across the 1982-83 school year. Teachers reported 
spending an average of 19% of their school week on STL-related 
activities. STL required teachers to spend more time prepar- ' 
ing students (e.g., grouping, pre-testing) and allowed less 
time tor curriculum coverage. . 

• Roles andjesponsibilities . Most of the training ias done by 

rlTrl/^ l"^. T^^ ^"'^■^y ^d"»inistrators Ld teachers. 

Teachers rated the. interactive support received by the five 

^^^nXf''^^^' involved in STL as average or above. Teachers and 
ntll ^'^"•^"^.f received the highest ratings land devel- 
iS.^lLlr'^ cJf ®y '^^^ beginning of June 1983. 

IttfT^ received by all central office 

"nJ? ^ t ^ ^'^^^^ admmMmms and teachers at the 
pijot school. Training, had bdi.v^ t^ceived by all central 

offihP It °^ school. administrators and 25% 

S jL.r''^"' \' the pilot school. Twenty-five percent of 
the teachers at the pilot school had received help . 
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• Ifr pact. STL has had an impact on training and on the .school 
^^^l'°";^^"^'^'^^u'" involved. In the area of training . ' 
and ^^f 1^ l^Tt""^ '^"^ understood the moSel 

and 5.0% felt that their teaching ability had improved as a 
result of their involvement with STL. Sevkral teachers felt 
that they needed to learn more ab oat STL. 

The pilot school benefitted from STL in terms of in^^eased 
cooperation among educators and students, recognition, know- 
ledge of a new teaching technique, and increased time to 
develop the curriculum. 

STL has had an impact at the classroom level (e.e. <?TT 1« p 

. worthwhile_^workabU instructional mo_delJ_in ter^s of the use 

ot peer tutoring, increased opportunities for students to 
advance, and instructional variety. 

I^achers improved their skills in a new teaching technique, in 
classroom management/organization/planning, in the use of peer 
teaching, and in assessing student progress/needs. They also 
strengthened their attitudes /perceptions of ^how well students 
can work together and about teaching. 

Increased student achievement was perceived to some 'degree bv 
educators and evidenced in test scores. Affective student 
impact was perceived in terms of enjoyment and an ±^^^^ 
attitude toward learning and school. . . 

• Participant Concerns. Educators were concerned about the 
amount of time required by STL and by the tendency of some 
students to "goof off" while in their groups. Recomended 
changes fell into the categories of implementation;;^:;arf tion 
(e.g., more bulletin boards for publicizing team scores pnH 
more workshops) , involvement (e.g. . have only J^lun^arJ' 
exSn.r expansion (e.g., use by all instructors) and 

external assistance (e.g., mSDE should provide continued 
,support and develop materials for use in business .education) . 

Factors influencing relative success include: (1) educators' interest in 
trying STL. and (2) their belief that students enjoyed this instructional 
model. Changes in project objectives appear to oe related to perceived impact 
/and the implementation strategy being used. Capacity building (staff develop- 
ment) had the advantage of giving trainees the responsibility (ownership) for 
implementation, but gave energy to dissemination and a general level of STL 
use rather than focusing on "fine-tuning" application. E'ducators may want to 
consider the relative desirMMiity (and investment of energy) m. having many 
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teachers familiar with STL (and using it when they choose) versus having some 
teachers using STL with selected subjects or units to the degree that students 
do not "goof off," but rather learn more or better. 

Washington County .* Washington has been implementing STL for 'two years 
using a capacity building strategy (and had previously used STL as a pilot 
site for the developer). In September 1982, educators considered three of 
the nine objectives specified in Table 30 as not relevant for their project 
(curriculum alignment, helping teachers become better organized, and improving 
time-on-task). The other six objectives had been "partly achieved." In June 
1983. two objectives were added to the six specified in September (helping 
teachers become better organized, and improving time-on-task) . These two 
objectives, along with two other objectives (informing local educators about 
the model, and training local educators to use the model) were "partly 
achieved." The remaining four objectives were "achieved." 

After the first year of implementaTion (June 1982)'. STL was being used 
in two schools (one elementary and one middle school) by eight teachers with 
300 students i. a variety of subject areas. Four of the elementary teachers 
had become involved with STL in 1977 as part of the ^ilot testing of the model 
conducted by Johns Hopkins University.^ By June 1983. fourteek schools of all 
types and 20 teachers were using STL with 600 students. 

Teachers used STL periodically throughout the school year. Dissemination 
had not been as successful as originally anticipated. By the beginning of 



sources (e.g.. Key Contact Questionnaires). 
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June 1983. information had been received by .25% of the educators and training 
had been given to 25% of the teachers. The coordinator of the Professional 
Development Center is currently responsible for follow-up assistance. 

STL has had an impact on the schools, educators, and students involved. 
At the school level , it promotes fair competition, and is easy and inexpen- 
sive to use. Increased student achievement has been perceived by educators 
and evidenced in better retention of information and in improved grades. 
Educators expressed a concern over the time required for materials prepara- 



tion. 



Factors influencing relative success include: 1) initially ambitious 
objectives (to have many teachers trained and voluntarily using STL after 
workshops), 2) conflicting priorities for central office staff (too many 
tasks to be done) combined with delays in delegating or sharing tasks with 
others, and 3) a capacity building strategy which gave teacher implementers 
autonomy of use (with many high quality applications), but which had no 
organizational support mechanisms. For the 1983-84 year, as the county adds' 
Active Teaching and Mastery Learning to their SiTIP activities, educators / 



-may want to consider processes to support implementation by teachers, and 
determine organization and communication structures and strategies to 
facilitate achievement of objectives matching local priorities. 

Worcester County . Worcester has been implementing STL for two years 
using a capacity building strategy. In September 1982, educators had already 
"achieved" improvement of students' involvement in learning. All of the other 
objectives specified in Table 30 (except improving time-on-task, whi -h was not 
considered to be relevant) were "partly achieved." In June 1983, improving 
time-on-task was an "achieved" objective along with informing local educators 
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about the model, training local educators to use the model, and improving 
students' involvement in learning. The remaining five objectives were "partly 
achieved." 

• S£0£e_^ndljit|£sltir. After the first year of implementation 

(June 1982), STL was being used in one elementary school by 15 " • 
teachers and 302 students in a varietv of subject areas In 
June 1983, four schools (elementary and junior high/middle), 
16 teachers, and 400 students were using STL. Student Team- 
Achievement Divisions (STAD) was th^ most popular STL strategy. 



• Fidelity. The STL components addressed by 100% of the teachers 
were: including a mix of students on each team and publicizing 
team successes. The component least consistently addressed was • 
relating quiz/tournament scores to individual and team achieve- 
ment. The largest number of teachers reported that the coopera- 
tion and interaction among the students was the aspect of STL 
having the greatest impact on students. 

• Time. Educators spent an average of five months involved in STL 
across the 982-83 school year. Teachers report<.d spending an 
average of 174 of their school week'on STL-related activities 
STL required teachers to spend more time preparing students 
(e.g., grouping, pre-testing) and allowed less time for curric- 
ulum coverage.. 

School administrators spent an average of 38 days and central 
JiT. .1 I an average of 15 days on SITIP. Central office 
staff felt that SITIP took somewhat more time and energy and 
school administrators reported that SITIP took "substantially 
more effort than similar previous projects. • 



• Roles and responsibilities . School administrators and central 
office staff combined spent the least amount of time and energy 
°H "^jerials development (1.50)** and the most amount of time on 
administration (4.25). School administrators also spent "quite 
a lot of time on inservice. 

Most of the training was done by school administrators and 
teachers, although some teachers received training/information 
from the developer, MSDE, and central office staff Durine 
- the sumer (1982), STL workshops were conducted and attended 
by teachers from 11 schools. Educators rated the interactive 
support received from the five role groups involved in STL as 
average or above. Teachers received the highest ratings and 
central office staff the lowest ratings of support. By the 



■ * Central office staff were also involved in another model. 

** Level of effort (time and enercv') up*? T•n^or^ r,r> o i ^ « / 

5.00 (a great deal). ^"^^8^^ was rated on a scale from 0 (none) to 
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beginning of June 1983. all teachers. 75% of the school 
administrators, and 50% of the central office staff had 
received information about STL. Training had been received by 
all teachers in. the pilot school and by 25% of central office 
staff, school administrators, and other faculty. Help was 

^^^-^'^ °' the'othirfaculty 
in the pilot school. cn.uj.i.y 

ISESCt. STL has had an impact on training, on the school 
system, and on , the schools, educators, and students involved. 
In the area of training, teachers reported that they under- 
llT^t t r?^^' ^"""^ teachers felt that their teaching 
ability had improved as a result of their involvement with 

The school system has benefitted from STL in terms of shared 
experiences with other schools and knowledge of a new teaching 
technique. The pilot school has gained recognition Is an 

iboutlS' J'f "^"^ enthusiastic 

about STL. School administr^tn^c felt^that involvement in STL 
enabled them to learn a new teaching technique. 

Educators indicated that STL has had an impact at the class- 

^Sr^hev1'lV'?H --^hwhile. workable instru^al 

model). They felt that it provided instructional variety for 
students, ^eac^ improved their skills in a new tLclLg 
technique, in classroom management/organization/planning and 

°^ ^^"^ teaching. They strengthened theJr 
a^nribo^t'?::^'?"^ °' ^'^'^-'^ ^°«-her 

Educators were unsure whether STL increased student achieve 
a|Et. Educators did report that STL result ed in improved 

°^ °mat ion .(especially in basic . facts such as 

the'iratt?tud:''°b l^'^- '^^^'^ and improved 

J„P«^/ . T"" l^""i"g and school.. On the Student 

Questionnaire, students in grades one and two gave positive 
responses on all seven dimensions. ' . P°sitlve 

Concerns. Educators were concerned about the time 
required forjlanning and preparation, the difficulty T 
measuring achievement, and the possibility that STL could 
hold back academically, talented students. 

Recommended changes fell into the categories of implementa- 
tion/preparation (e.g.. allow more time for clas~s?oom 



259 

240 



Factors influencing relative success include: 1) strong support by the 
pilot school principal; 2) the energy, enthusiasm, and professionalism of core 
teachers at the pilot school;^ 3) perceived success by local educators (of 
students' enjoyment of STL); and 4) purposeful use of appropriate STL 
approaches by teachers for given subject areas and grade levels. Educators 
may wish to considet the extent of use by any given teacher and find ways (if 
appropriate) to expand (e.g., to include another unit), bearing in mind that 
time is needed for materials development. 

Teaching Variables (TV) 

As stated in Chapter II, Teaching Variables (TV) addresses two variables 
found to be strongly related to instructional effectiveness and student 
achievement: "content" and "time". Implementation of "content" involves 
curriculum alignment and systematic record keeping of students' progress; 
implementation of "time" involves systematic classroom observation and 
^strategizing to improve time-on-task. ' 

During 1981-82, five LEAs (Calvert, Frederick, Kent, Montgomery, and 
Somerset) implemented TV. In 1982-83, one additional county (Talbot) became 
involved in TV. This^section describes the implementation of TV including: 
planning; scope and intensity of implementation; time spent on implementing 
TV; roles and responsibilities of TV Implementers; TV Impact on school 
systems. Individual schools, educators, and students; and participant 
concerns. 
Planning 

The extent of involvement of TV implementers in MSDE-organized planning 
activities during the 1981-82 school year is summarized below: 

Of those implementers responding to the General Survey, school 
administrators were more heavily Involved in. . .planning than were 
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central^ of fice staff and teachers. Central office staff were 
more heavily involved in. . .planning than were teachers. (Roberts ' 
.. et al., 1982) , v.J^uueI:ts, 

For the 1982-83 school year. MSDE did not organize any group planning" 
activities but provided individual assistance in preparing the PEPPS p^roposal 
for the "new" LEA. 

i 

An analysis of local plans for the 1982-83 school year identified LEA 
objectives and the status of each at the beginning of September 1982.* Table 
42 presents the objectives. In each case, the' percent of LEA^ that "hoped . 
for", "partly achieved", or "achieved" each objective is indicated. As can be 
seen in Table 42. there were nine objectives identified. All nine were 
addressed to some extent by the LEAs. .Eight objectives were already achieved 
by some of the LEAs as of September 1982." The greatest area of accomplishment 
related to curriculum alignment, and the least to improvement in student 
achievement. ^ ^ . ' ^ 

•/ 

Scope and l atensity of Implementation 

In September 1982. six counties were involved in TV. Talbot was just 
beginning its involvement, As can be seen in Table 43. in June 1982. scope 
and intensity of implementation varied among the, five "veteran". LEAs from'two ' 
teachers in one elementary school in one county to 11 teachers in one elemen- 
tary and one junior high/middle school in" another county. Across the five " 
LEAS approximately six schools and. over 51 teachers in a variety of subject 
areas were involved in TV. - 

Table 44 presents the scope and intensity of TV implej;entation in June 
1983. Across the six LEAs. three implementation strategies were be^ng used 



Se7teS:r"r982?°' ^° ^"'"'^ information on status of objectives in 
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Table 42 ' 

Status of Local Objectives, 1982-83: Teaching Variables 



local Objectives 



1. Improve student achievement 
(basic skills) . 

2. Improve student achievement 
(other subjects). 

3. Inform local educators about model. 

^. Train educators to use model. 

5., Improve teacher's classroom 
^ competence. 

6. Ensure match of instruction, - 
curriculum and test(s). 

7. Help teachers become better 
organized.. 

8. Improve time-on-task. 

9. Improve students' involvement in ' 
learning (motivation),. 



Status 



Pre-Sept. 1982 



N 



Percent of Sites 



1* 



20 

20 

50 
50 
20 

60 

20 

20 
25 



2* 



AO 

60 

25 
25 
60 

40 

60 

60 
50 



3* 



40 



20 



25 



25 



20 



Post-June 1983 



N 



* 1 - Hoped for 

2 = Partly' achieved 

3 = Achieved 

o 
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20 

20 
25 



Percent of Sites 



'1* 



43. 
50 

29 
17 
14 

0 

14 

29 
60 



2* 



43 

33 

14 
33 
29 

33 

43 

29 

20, 



3* 



14 

17 

5,7 
50 
57 

67 
43 

43 
20 



■9 CO '"^ '"^ In Montgomery County 

(tb^^ submitted individual sets of objectiyes) 

N equals the number of sites addressing ^ach objective. 



A 



Table 43 

Scope and Intensity, June 1982': Teaching Variables 







LEA 


Strategy 


// of 
Schools 


lype 


//of 
ieacners 


//of 
Students 


i 

Subject Areas 


Calvert 


LS 




t/m 


18 


4 


R/LA, M, Sc, SS, 0 


•Frederick 


.PD. 




u 


1 Oj 

12+ 




R/LA, M, Sc, SS, 0 


■ Kent 


LS 




L 


0 

8 




R/LA 


Montgomery* 


LS 




£i) J/n 


11 


-A 


R/LA, M 


Somerset 


LS 




E 


2 




R/LA 


Talbot 


■' . » 

"New Distric 


t 




a. oae school were using TV as a data collection technii^ilSfli: ^ ' 



SHkiecLAreas: R/LA-Readlng, language arts 
. M^Mathematics 
Sc^Science 
SS=Social Studies 
O==0ther 

IZ£i' E^Elementary school 
J/M=Junior high/middle 
H=High school 
0=Other 



S^^ategy ; LS=Lighthouse school 
PD^Pflot district 
DW=Dlstrict wide " 
CB=Capacity building 
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LEA 



Calvert 



Frederick 



Kent 



Montgomery* 



Somerset 



Talbot 



Table 44 ' 

Scope and Intensity, June 1983: T.eaching Variables 



Strategy 



LS 



PD 



DW 



I of 
Schools 



Type 



J/M 



LS 2 



■LS 



LS 



1 



E, J/M 



I of 
Teachers 



23 



15 



32 



16 



0 



4 



lot 
Students 



540 



600 



676 



470 



217 



80 



Subject Areas 



R/LA, M, Sc, SS, 0 



R/LA, M, Sc, SS 



R/LA 



R/LA, M 



R/LA, M 



0 



Teachers at one school were using TV as a data^ffi^^^ 

jubject Areas; R/LA=Reading, language arts 

M=Mathen!atics 
Sc=Science 
SS=Soclal studies 

0=Other 



Strategy; LS=Lighthouse school 
PD=Pilot district 
DW=District wide 
CB=Capacity building 
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IZEi= E=Eleiiientary school 
J/M=Junior high/middle 
H=High school 
0=Other 



(lighthouse school — 4; pilot district — 1; district-wide — 1). Approxi- 
mately 98 teachers in 12 schools were implementing TV in a variety of subject 
areas. Reading/language arts was the most common subject area. The percent- 
age of schools in each county implementing tV in June 1983 ranged from 1% in 
Montgomery County to 50% in Kent County. Across the entire state. ]% of the 
schools were involved in Tv at the end of the 1982-83 school year. 

Some changes occurred between June 1982 and June 1983, the most obvious 
being the one new LEA: Talbot decided to use a lighthouse school strategy in 
one vocational-technical school with four teachers and 80 students in auto 
mechanics, maTsonry, carpentry, and agriculture. In general, the scope and / 
intensity of implementat .on increased between June 1982 and June 1983 across 
the five "veteran" LEAS, None of the five districts changed its implementa- 
tion strategy. Two LEAs increased in number of schools. All five LEAs / 
Increased 'the number of teachers implementing the model. 

As mentioned earlier,, TV includes a "time" and "content" variable/ 

/ / 

Sixty-two percent of the survey respondents reported implementing tH^ "time" 
variable while 30% implemented the "content" varikble. Only 22% of the 
teachers implemented both variables. 

Thirty-four percent of the respondents implementing the "time" variable 
had observed other teachers' and 36% had been, observed by teachers, 72% by 
school administrators, and 49% by central office staff. Forty-five percent of 
the respondents strategized during staff meetings. Forty-seven percent of the 
respondents did not need to make any changes in their teaching strategies 
since the student engaged time was already high. However, 51% did make 
changes to improve time-on-task and 36% reported that these changes were 
successful. 
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Twenty-eight percent of the teachers implementing the "content" variable 
reported- matching curriculum, instruction, and the CAT; 23% were aware of 
their\student's prior learning (i.e., what students had been taught and their 



test scores for the previous school year); and 15% kept records of the content 
covered by.iobjective for each report period. Twenty-three percent of the 
teachers had to modify thp existing curriculum and/or their instruction. 
Time Spent \ on the Model 

This section discusses time spent on TV during the 1982-83 scfiool year. " 
Time across the school year is discussed first, followed by a discussion of 
the time spent by teachers in the classroom and by school administrators and 
central office staf^.* 

Across the School Year . During 1981-82, the majority of the teachers 
began TV implementation in September and finished in May or June. One county 
did not begin "time" observations until February and another LEA did not begin 
until April. 

During 1982-83, implementers across the six counties were Involved in TV 
for an average of eight months. No county was Involved for less than five 
months. Calvert had the highest and Frederick the lowest average number of 
months involvement. ^ . 

In the Classroom. During the 1981-82 school year, most counties were . 
implementing the "time" variable and each teacher was observed approximately 
three times. When appropriate, teachers applied improvement strategies 
following analysis of observation data. In Calvert, also teachers applied a 



Ihxj information is based primarily on the responses made by a sample of 
implementers. who completed the General Survey. There were no central office 
respondents from Somerset County or school administrators responding from 
Frederick County. 
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modified version of the "conterit" variable for most of the school year. 
Calvert and Montgomery were the only LEAs that reported implementing both the 
"time" and "content" variables. 

In 1982-83, the teachers responding to the General Survey (N=33)* 
indicated that they spent an average of 29% of their school week on TV-related 
activities. Elementary teachers spent an average of 33% and secondary ^ 
teachers an average of 19% of their school week implementing TV. These time 
allocations refer to the subject area for which "time" observations were 
conducted and/or "content" procedures were applied. 

For the "time" variable, the number of observations made per teacher 
across the school year ranged from three to six. Most of these observations 
were done by school .administrators . Forty-five percent of the teachers 
reported discussing observation results and strategies to improve time-on-task 
during staff meetings. 

Time Spent by Administratoi s. ** Twelve school administrators and central- 
office staff across the LEAs spent an average of 15 days on SITIP. In 
general, school administrators spent slightly more time on STTIP (16 days) 
than central office staff (13.5 days). 

Fourteen school administrators and central office staff reported spending 
about the same amount of time and energy on SITIP as they had on similar 
previous projects. However, central office staff In Calvert and Montgomery 
Counties and school administrators in Montgomery and Somerset Counties 
reported that "slightly more" to "substantially :„ore" time and energy had been 



* No data were available from teachers in Talbot County. 
"ot^:i"mo1e"s!" Montgomery Counties were also involved with 
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spent on STTTP, while school administrators from CalvRrt. and school admlnis- 

■ / ; /' ' ' ■ 

trators and central office staff from Talbot reported "slightly less". 
Roles and Responsibilities 

The SITIP design encourages inyolvement of a cross-hierarchical team, 
including: 1) central office staff,' e.g., supervisors in instruction or 
coordinators of staff development; 2) school administrators, e.g., principals, 
vice principals, or department heads; and 3) classroom teachers. This section 
describes- the people involved, what they did, and their relationship to each 
other from three perspectives: usual assigned roles, activities undertaken, 
and interactive support. 

Usual Roles. Teachers, school-based administrators, and central office 
staff were all involved in TV. jOf the seven central office staff responding 
on the sur^•ey, two were in staff development and five were in Instruction. 
All six school administrators responding on the F/arvey were principals (3 
elementary, 1 junior high/middle, and two no grade level indicated). In 
general, TV implementation was carried out about equally by elementary and 
secondary teachers. 

Activities and levels of effort. On the General Survey, six activity 
areas were identified and central office staff and school administrators from 
those LEAS .responding to the, survey were asked to indicate level. of effort 
(time and energy) spent on each: (with responses ranging from A "none" to 5 "a 
great deal). The areas of actijrity were: 1) administration//( including 
planning and budget); 2) development of materials; 3) designing and/or 
conducting inservices; 4) suppotting- school implementation ie. g. , problem- 
solving, supplying materials, etc.); 5) dissemination; and/|) evaluation. 
(Mean ratings are presented in Table 45.) 
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Table 45 

Level of Effort: Teaching Variables, 1982-83 

0 




Th^ lovel of effo-t sponr by utral office staff and school administra- 
tors on each activity during the first year of implementation is summarized 
below: 

/ Levels of effort were most similar for central office staff and 
school administrators in the areas of dissemination and materials 
development, followed by training, support, and evaluation, with 
most difference on administration. The greatest combined effort 
was spent on support and the least on materials development 
(Roberts, et al. , 1982). 

As can be seen in Table 45, during the 1982-83 school year, school 
administrators and central office staff combined spent the least amount of 
time on the development of Materials (1 .86) and the most time on administra- 
tion (3.00). Most central /office effort was jjpent on administration and 
supporting school implementation (3.29 for each activity). School administra- 
tors spent most of their time on administration (2.71). 

! - / • ■ ■ " ■ 

I Individual county responses indicated that there was some level of effort 
spent on each activity across all the LEAs with the exception of materials 
dWelopment in two I counties. Administration received the highest level of 
effort in all the counties jexcept Talbot; materials development in one county 



(Culvert); designing and/or conducting inservice in two counties (Calvert and 
Talbot); supporting school iimplementation in three counties (Montgomery, 
Somerset, Talbot); disseminiation in one county (Somerset); and evaluation in 
one county (Frederick) . • 

/ Interactive Support. Teachers implementing TV. could receive training/ 
information fpm four sources: developers, MSDE, .central office staff, and 
sokool-based staff (School administrators and teachers). The majority of the ' 
tiachers .responding t'o the survey (56%) received information and training from 

and teachers. 



s/chool administrators 
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In Calvert (67% of the teachers) and Frederick (73%) most teachers 
received information/training from school-based staff; in Montgoroery County 
< f - developer and/or school-based staff; in Kent County (65%) from 

central office stalF; in Somerset County from MSDE (60%); and in Tal t County 
(67%) from the developer and/or MSDE. 

Survey respondents were asked to rate the support received from teachers, 
principals... central office, MSDE, and developers (f^ I.OO: very good, to 
5.00: excellent). Ratings of interactive support from the 1982 survey are 
summarized below: 

...for TV, central office staff were generally more positive in 
their assessment, rating all groups between 4.00 and 4.50. 
School administrators rated teachers highest (4.60) and 
considered central office support average to good (3.40). 
Teachers rated their colleagues as average to good (3.56), and 
awarded the lowest rating to central office staff (2.81 ~ just 
below average). Teachers received a. mean rating of 3.96, with 
teachers themselves awarding the lowest, rating (3.56)'.' School 
administrators .received a mean rating of 3.85, with central 
office staff awarding the highest rating (4.50). Central office 
staff received a mean rating of 3.19; MSDE received a mean of 
3.56, and topic developers were awarded a mean rating of 3 37 
^. (Roberts et al., 1982) 

As shown in Table 46, respondents of the 1983 . survey rated the inter- 
active support received from all five role groups as. in general, average 
(3.00) and above (except for central office staff and developers who received 
mean ratings below 3.00). Teachers received the highest and developers the 
lowest ratings of support. Teachers tended to be the least positive in their 
assessments. 

The mean ratings given by the survey respondents in each of the indivi- 
dual counties were generally average (3.00) and above except for ratings of 
central office support in Frederick (2.33). Montgomery (1.87), and Talbot 
(2.80) Counties; MSDE support in Frederick (2.75) and Montgomery (2.78) 
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Table «6 



Perceptions of Support Received: Teaching Variables. 1982-83 



Respondents 



Central Office 

School Administrators 
Teachers 

it 

Total 



48 



61 





Sun 


[^ui,u uroups 






Teachers 


. School 
Administrators 


^' ' Central 

UUiCc oiul 


MSDE 


1 

Developers 


3.86 


4.14 ' 


3.83 


4.00 


3.1? ' 


4.33 


■ 4.1] 




4,1] 


3.33 


3.65 


3.50 


2.90 


3.08 


2.80 ■ 

t 


3.74 


t 3.64 


2.98 


3.29 


■2.90' 
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Counties; and developer, support In Frederick (2.50), Kent (2.90), and Mont- 
gomery (2.25) Counties. 
Impact 

This section discusses TV Impact In the area of training and on school 
systems. Individual schools, central office staff, school administrators, 
teachers, and students. ^ ^ . . 

Training . MSDE TAs held one follow-up training session for those 
counties Implementing, TV. The session was a combined follow-up held In the , 
fall of 1982 at MSDE with participants implementing AT and STL.- " Eleven TV 
participants were present. During this joint follow-up. the 1982-83 evalua- 
tion design was reviewed by RBS. and participants met in small model-specific 
groups to review plans and to share needs and concern's. 

• TV participant evaluations of the follow-up (e.g.. clarity . "relevancy . 
and accomplishment of objectives, support from MSDE) were positive, the mean 
responses ranging from 3.91 to 4.83 on ascale from 1.00 (least positive) to 
5.00 (most positive). The majority of the TV participants considered the 
small group discussions and evaluation overview as the beiSt parts of the 
session. The needs. expressed were varied, including requests for help in 
dissemination and for more information on tine-on-task. 

Teachers received information and training from a variety of sources, but 
for the most part, fro'm school administrators and teachers. The majority of 
the teachers indicated that they understood the model (64%). Twenty-eight 
percent of the teachers indicated that they needed to learn more about the 
model. A larger percen^iiT^f-- teachers indicated that their teaching ability 
had not changed as a result of TV (36%) in comparison to teachers that 
indicated a change in teaching ability (28%) . 
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Qbservers (all three role groups, but more often principals and super- 
visors) were trained by MSDE staff and/or developers. They 'applied TV, 
usually conducting "time" observations for participating teachers twice a 
year. They understood the procedures and carried them out appropriately. Use 
of data — as feedback to teachers — was also carried out as designed by the 
developer. Actual stratgizing for improvement in most cases appeared to be 
influenced primarily by the observers' experience (rather than by team exper- 
tise or a research base) . This reflects partly on the perceived inadequacy of 
the research base for grades '6 and above. 

School systom. The impact of an innovation on a school system involves 
changes in practice or policy that affect or could affect more than a single 
school or single group of educators. Systemic impact of TV occurred in two 
LEAs where principals and supervisors were trained to use TV as a classroom 
observation technique, and were using it on either a formal or informkl basis. 
In a third LEA, training was provided for staff in schools other than the 
pilot site, with options fjor voluntary use. To date there is no widespread 
systematic use. 

Central office staff. TV enabled central office staff to learn about a 
new observational technique (5 LEAs) . Central office staff in one LEA. 
reported that the high .engagement rates of students across the district 
confirmed that teachers were already aware of time-on-task. These results 
suggest that central office staff gained knowledge which some of them 
incorporated into their classroom observation practices. 

Schools. The impact 'of an innovation on a single school involv-d only 

those educators within that school, TV impact, on eingJc schools included: 

• increased time-on-task— more effective management of class- 
room time (3 LEAs) ■ , 



274 



• new teaching techniques (4 LEAs) > \\ ^ 

^ 

' \ \\ 

" • curriculum alignment (1 LEA) 

• new perspective on possible reasons for seode.ntv learriW 
problems (1 LEA) . " \ 

» ability to improve^ specific areas of instruction (1 LEA) 

• use of pre and post tests to measure growth (1 LEA) 

• awareness of Importance of good teaching (1 tEA) 

• sharing/cooperation among staff (3 LEAs) 

• notoriety (1 LEA). ' . 

.. School Administrators. School administrators -felt that tfieir involvement 
in TV,.enabled them to learn a new teaching strategy/observational technique (3^ 
tEAs), made them more aware of time-on-task (2 LEAs) , enabled them to work 
withother staff (1 LEA), ancf gave ' thfem the seif satisfaction of being 
involved with an effective program .,1 LEA). These results -suggest that school 
administrators perceive the TV "time" procedures primarily as a useful 
observational technique.. 

Classrooms and Teacherti. Impact on teachers fell into 11 ^categories 
under the three general, areas of: 1) increased knowledge/awareness. 2) 
improved skills, and 3) strengthened attitudes/perceptions (see Table 47). In 
addition, survey respondents assessed relative instructional value' and impact 
on teachers in six areas on a five-point Likert scale (see Table 48). > 
Improved skills in a new teaching/observation technique was the teacher 
impact category reported^by all role groups across the largest number of LEAs.- 
As can be seen in Table 48. survey, respondents indicated that TV is a worth- 
while, workable model ~ mean responses ranged from 3.73 to 4.00 (on a scale 
from 1.00. least< positive, to 5.00. most positive) . They also "indicated that 
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Table A 7 



Impact on Teachers as Reported by 
Each Role Group: Teaching Variables. 1982-83 



•"' ^ — ~ 

•tf 

Impact on Teachers 


Role Groups 
(Reported in No. 
of LEAs; N=6) 


CO 


1 SA 


T 


As a result of ' TV tearhpTc hairo- 








Increased knowledge/awareness 








-of learning theory. 

-of time-on-task . . * 
-of classroom procedure^^ which are/are not 

effective, 
-of curriculum alignment, 
-of the research. 

Improve^ skills 


0 

-/ 0 
0 

0 
0 


1 
1 

0 . 

0 
0 


0 
2 
2 

1 

1' 


-in a new teaching/observation technique, 
-in classroom manaeement/or&fln^7fl^^ nn/ni aT^«-T«« 
. -in assessing student behavior/attitudes/needs, 
-in controlling time-on-task. 


3 
0 
0 

. 0 


2 
0 
1 
0 


5 
3 
3 
2 


Strengthened attitudes/perceptions 








-about teaching (e.g., involvement, cooperation, 
sharing, morale, self esteem, professional 
growth, recognition, etc.). 

-about -the importance of keeping students 
on task. 


1 
1 


2 

2 • 


3 
1 



GO=Central Office; SA=School Administrators; T=Teache 
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Table 48 



Instructional Impact as Perceived by 
Survey Respondents: Teaching Variables, 1982-83 



Impact on Instruction 



Instructional Value 

0 

Works in classroom.' 

Is worth the work it takes. 

Is a worthwhile teaching approach. 

Impact on Teachers 

Teachers enjoy it. 

Teachers have increased knowledge. 

Teachers have increased skills. 

Impact on Students " 

Students enjoy it. , 
Students are less disruptive. 
Students' achievement has increased. 
Students are learning more. 
Students' general behavior is better. 

Time 

Teachers spend more time preparing students 
Teachers cover curriculum in less time. 



Role Groups 



CO 
N=7 



4.00 
4.41 
3.86 



3.71 
4.00 
4. 14 



3.57 
3.14 
3.57 
3.29 
3.57 



2.°57 
2.86 



SA 
N=7 



4.29 
3.86 
4.14 



3.86 
4.14 
4.00 



3.29 
3.00 
3.43 
3.00 
3.57 



3.14 
2.86 



T 

N=49 



3.96 
3.65 
3.73 



3.49 
3.47 
3.35 



3.55 
3. 12 
2.96 
2.71 
2.94 



2.65 
2.77 



Total 
N=63 



4 . 00 
3.73 
3.79 



3.56 
3.60 

3:51 



3.52 
3.11 
3.08 
2.81 
3.08 



2.69 
2.79 



Mean ratings range from 1.00 (strongly disagreed to s nn r ^ i 
CO=Central Office; SA=School Adminis'tratorsf ?=TeLhe;s ^ ' "^'"^ 
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teachers enjoyed TV and Increased their knowledge and skills (mean responses 
ranged from 3.51 to 3.60), but these ^responses were not ashigh as the 
responses given to classroom impact. Teachers were consistently lower than 
the other role groups in their ratings of teacher impact and instructional 
value'. 

students. Impact of TV on students fell into ten categoric/ under the' 
three general areas of: (1) improved attitudes or awareness^^) increased 
achievement, and (3) benefits from better instruction (see '^'able 49). Also, 
LEAs were asked to submit data summaries of cagnitive and/affective measures 
assessing TV impact in terms of student achievement and /attitudes. The 
results of these measures are also summarized in this Section. Increased 
achievement as evidenced in test scores was the most /commonly reported 
category of student impact across all three role groups. Improved awareness 
about classroom behavior and time-on-task was the s/uderit impact category 
repotted by teachers from the largest number of LEAs. As can be seen in 
Table 49, survey respondents were not sure if stuZnts' behavior was better/ 
less disruptive (3.08 and 3 . 1 1 respectively) ,^ll{ther student achievement had 
increased (3.08) or whether students were learning more (2.81) as. a result of 
TV/ 

None of the LEAs submitted usuable affective data measuring the impact of 
TV on student attitudes. : • 

Cognitive measures of student impact were submitted by Kent and Somerset 
Counties. Kent County reported CAT data for grades one through four from 
Spring 1981 through Fall 1982. Since implementation began in April 1982, 
these data are useful only to contribute to trend analysis as tests are given 
in 1983 and 1984. To date, no conclusions can be drawn. . 
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Table 49 



Impact on Students as Reported by 
Each Role Group :- Teaching Variables, 1982-83 





Role Groups 
(Reported in No. 
of LEAs; N=6) 


Impact on Students 








CO 


SA 


T 


As a result of TV students have: 








Improved attitudes or awareness 








-about learning and school: (e.g. , increased ' ^ 
interest; cooperation, involvement, enthusiasm, 
motivation). 

-^about classroom behavior/time-on-task. • 

-of teacher interest 

-of value of being organized. 


0 

0 
0 
1 


' 0 

0 
0 
0 


2 

4 
] 
1 


Improved achievement 








-in test scores. 


2 


^ 


3 


Benefitted from better instruction 
which provides 








-a greater variety of activities, 
-a more complete program, 
-clear teacher expectations, 
-more organization . 
^ -more attention to academic content. 


'l 
0 
0 
0 
0 


o o o o o 


0 
1 
1 
1 
1 



'=Central Office; SA=School Administrators; T=Teachers 
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Somerset County submitted Spring' 1983 CAT scores for reading and math for 
grades one through three. The impact that TV had on these scores cannot be 
measured since no comparative data (e.g., pre-test scores, trend analysis) 
were provided. 

"Cause and effect" claims cannot be made for any of the sites in terms of 
direct impact of -TV on students. The relative uncertainty of survey respon- 
dents, together with anecdotal data collected during the year, suggest that 
any impact TV may be having on teachers is not being felt by students. 
Participant Concerns " 

^ Chart 8 lists the concerns reported by TV implemanters. Concerns were 
divided into model and implementation concerns, with all LEAs . reporting the * 
former, and four LRAs reporting the latter. The most common model concerns 
were that TV is complex and difficult to implement, takes too much time and 
paperwork, that some of the coding categories may not be appropriate, and that 
teachers are often afraid of or feel pressured by peer observation. The most 
common implementaL.tion concern was time. ^ 

Chart 9 lists the recommendations/solutions which were divided into four 
general areas: implementation, involvement, expansion, and external assist-- 
ance. The largest number of LEAs made recommendations in the.area of imple- 
mentation. In the three LEAs recommending expansion other educators within 
those LEAs expressed concerns about the model (e.g. , ''negative teacher ~^ 

o 

attitudes, time). 

These results suggest that each LEA should examine the relative value of \. 
TV, how it is being used, and what improvements can or should be made. 
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Chart 8 

Concerns /Problems Reported: Teaching Variables, 1982-83* 



Model concerns 

Lack of research base (1) 
Complexity, difficulty to implement (2) 



?LrhPr^f ''J'^ '"'"^ °^ ■^^'^^"S categories/too judgmental (2) 
Morfn. P«« observation/pressure of being observed (2) 

More useful for new teachers (1) . 

Requires too much time and paperwork (3) 



Implement;ation concerns 



Lack of central offide support (1) 

Those involved did not know why TV was being done (1) 
General negative attitude/teacher apathy (1) 
Lack of time (2) f y k j 

Leaving class to substitutes (by teacher observers) (1) 
Observers were not monitered (1) 



* Figures in parenthesis indicate the number of LEAs making a given statement, 
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Chart 9 \ 
Recoimnendatlons/Solutlons: Teaching Variables, 1982-83* 



Tmplementatlon/preparatlon 

Provide, more time to strategize (1) 

Provide more specific ideas for improving instruction(l) 
Provide more time for paperwork/require less paperwork (2) 
Implement the content variable (2) 

Do not begin implementation during first few days of school (1) 
Do not exiiect implementation (in 2 years) of TV on top of new LEA 
priorities (1) 
Assign new leadership (1) 

Involvement 

0 • 

Drop program-waste of time/drop time-on-task analysis (3) 
Teachers must see value of process (1) 
Not for every teacher (1) 

Expansion 

Increase number of educators/subject areas/schools (3) 
External assistance 

MSDE should increase funding (1) 

More central office support (1) 

More central office and MSDE workshops (2) 

More networking/ sharing among cotmties and within county (2) 



* Figures in parenthesis indicate the number of LEAs making a given statement 
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Suiinmary and Conclusions 

In the preceding "pages each research question or issue has been addresye 
and findings discussed across LEAs. Here some general conclusions across 
Issues and LEAs are reviewed. Then activities are summarized for each LEA.'^ 

It is apparent that TV is perceived primarily as a classroom observation 
strategy used in the supervision of teachers. Only in Calvert and Montgomery 
is that perception modified to have a professional development orientation. 
(It is interesting to note chat both those sites used both "time" and 
"content^* variables.) In all cases the "time" variable of TV was applied as 
diagnostic/prescriptive assessment/assistance technique designed to improve 
teachers' classroom management skills. However, the emphasis varied among 
LEAs. In two LEAs the improvement activities were emphasized, (and there the 
principals acted in support of teachers); in three LEAs there was more 
emphasis on assessment (with principals acting as observers and subsequently 
making recommendations); and in one LEA there was a dual purpose, one 
attending to the immediate activities of teachers observed and the other 
addressing a more distant research-.orlented objective (with the principal 
somewhat disassociated from both). The demands of TV were high, particularly 
for scheduling observations (and, in some cases, dealing with difficulties 
related to use of substitute teachers). Also, since TV was perceived by many 
teachers as an evaluation system, there was resistance to the model that, was 
not always overcome. 

Impact was made to a small extent on students' attitudes to learning and 
the importance of using l ime well. There was almost no evidence of -fir.pact on 
.achievement. 



* Levels of Information vary because some LEAs provided more documentation or 
other evidence of model Implementation. 
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Impact was made on individual teachers' knowledge and on classroom 
management skills. \ However, although educators considered that they improved 
time on task, 'pey \±d not necessarily consider that teaching ability improved 
(apparently perceiving those as two separate sets of behaviors), when 
strategizin^g fo^ improvement occurred in staff meetings, teachers' isolation 
and resistance decreased. Impact was made on the school system when super- 
visbrs Incorporated TV into their classroom observation activities, or when 
training was provided to" others outside the original pilot school. 

The strategies used to^ communicate across hierarchical levels and to make 
declsipns (particularly as to the purpose of classroom observations) were 
crucial to the relative success of the project. Impact was more positive when 
teachers: (1) believed that their opinions counted, (2) valued the recommen- 
d.ations for improvement made by observers and/or their colleagues, and (3) 
believed that the purpose of TV was to share improvement strategies re Want 
tp identified needs rather than to evaluate an aspect of their classroom 
behavior; when principals: (1) emphasized professional development, and (2) 
found^that TV directly contributed to an, existing school priority or need, and 
then planned and acted to fit the model and the priority together; when ■ 
\,^entral office staff: (1) supported open communication and shared decision- 
m\king, involved teachers in clarifying the purpose of the project and how 

bes^ that should be achieved, (3) accessed appropriate training and informa- 
tion\assist;ance, and (4) maintained leadership, linking across hierarchical 
levelsUo iJarticipate in information exchange and to support school-based 
implemen^tiqn. positive . impact was reduced or barriers created when : (1) 
teachers Velt that^TV observation and feedback were -evaluative and lacking 
credibility either, in the definitions of coding or in the relevance and value 
of the reconteendations made); (2) teachers perceived the project as an 
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assessment system; and (3) the purpose was not discussed and clarified among 
role groups. Since the "content" variable had a strong instructional 
emphasis, requiring teacher participation in lesson planning to assure student 
opportunity to learn stated objectives, when this variable was implemented 
there was less resistance from teachers, and a stronger focus on the "improve- 
ment" purpose. 

Given the nature of Tv' as implemented in most sites, its primary value 
appears to have been in providing principals and supervisors with a systematic 
method of determining time-on-task. 

In the following case reports of the six LEAs implementing TV. attention 
is given to the influential factors mentioned above and also to specific 
objectives and results ac.hieve.d at each site. 

Calvert County . Calvert has been implementing TV for two years using a 
lighthouse school strategy, m September 1982,, those involved in the project 
"hoped" to inform educators about the topic and had "partly achieved" the 
remaining eight objectives specified in Table 42. In June 1983-. three objec- 
tives were "hoped for" (i.e., improving achievement in the basic skills and in 
other subject areas, and improving students' involvement in learning) . One 
objective (i.e.. ensuring a match of instruction, curriculum, and tests) was 
"achieved". The remaining five objectives were "partly achieved". 

• Scope and Intensity . After the first year of TV implementa- 
tion (June 1982). TV was being impleireated in one middle 
school in a variety of subject areas. In June 1983. the two 
other middle schools were beginning their involvement. Educa- 

. tors_were implementing both the time and content variables. 

Two teachers observed all the teachers at the pilot middle 
school periodically during the school yeair. Administrators 
did not observe, which helped to alleviate teacher nr-iety and 
resistance. Strategy sessions were held to help the teachers 
find ways to improve time-on-task. Instruction was matched to 
state and county objectives and to the CAT. Checklists of 
objectives were developed for teachers to record when instruc- 
tion was provided. 

o 
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• Time , Educators spent an average of ten months involved in 
SITIP across the 1982-83 school year.* Teachers reported 
spending an average of 39% of their school weed on TV-related 
activities (e.g., observation and application of strategies to 
increase time-on- task during the course of instruction in r.he 
subject areas selected). 

c 

The 'school administrator reported spending 30 days on SITIP, 
spending "slightly less'' time and energy in comparison to 
similar previous projects. The central office respondent 
reported spending "slightly more" effort on SITIP. Educators, 
in general indicated that TV did not require teachers to spend 
more time preparing students (e.g., grouping, pre-testing) . 

• Roles and ResponsiMlities . School administrators and central 
office staff combined spent the same amount of time and effort 
(4.00)** ou all six activities (i.e., administration, 
materials development, inservice, supporting school implemen- 
tation, dissemination, and evaluation). Central office spent 
"a great deal" of effort (5.00) on all activities except 
evaluation which received "quite a lot" of time and effort 
(4,00), The school administrator spent some effort (3.00)^ on 
all six activities. 

Most of the training of teachers was done by school-based 
staff. Educators rated the interactive support received by 
the five role groups involved in TV as average (3.00) and 
above with the exception of the school administrator's rating 
of .central office support which received a rating of 2.00. 
-Schdol administrators received the highest ratings and central 
office the lowest ratings 'of support. By June 1983, informa- 
tion and training had been received by about 25% of the 
educators in the district. Help had been received by about 
75% of the central office staff and teachers and 50% of the 
school administrators. 

» Impact . TV has had an impact on training and on the schools, 
educators, and students involved. In the area of training , 
50% of the teachers felt that. they understood the model. How- 
ever, 50% also indicated they would like to learn more about 
the model. Fifty percent reported that their teaching ability 
had improved as a result of their involvement with TV. 

At the school level , involvement in* TV has enabled educators 
to learn a new teaching technique and has promoted sharing and 
cooperation among the staff. 



* The central office staff and school administrator were involved xr^th more 
than one model. 

** Level of effort (time and energy) was rated on a scale from 0 (none) to 
5.00 (a great deal). 
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Central of fice staff reported that TV enabled them to acquire 
better organizational skills and to learn a new teaching ^ 
technique. - School administrators also became aware of a new 
teaching strategy and were able to work more closely with 
their staff as a result of TV. 

. Educators indicated that TV has had" an impact at the classroom 
level (e.g.. TV is a worthwhile, workable instructional 
model). TV had resulted in a greater variety of instructional 
activities. Teachers enjoyed TV and increased their knowledge 
and SKills. especially kxaowledge of the relevant research and 
skills in a new teaching/observation technique, in classroom 
management/organization/planning, and in assessing student 
behavior/attitudes/needs. Teachers also strengthened their 
attitudes about teaching as a result of TV involvement. 

Increased student achievement was perceived to some degree by 
educators although no formal assessment data were provided. 
Affective student impact was perceived by educators who felt 
that their students enjoyed TV and were less disruptive. 
Students also improved their attitudes about learning and 
schooI>and their awareness of classroom behavior, time-on- 
task. and teacher interest. 

• Concerns and Changes. Some educators did not agree with some 
of the- coding categories and were concerned about teachers' 
fear of peer observation and lack of central office support 
They recommended more time for paperwork, more workshops, 
increased networking, and expansion during the 1983-84 school 
year. 

Factors Influencing the relative success of the project included: 1) the 
'expertise developed by the teacher-observers. 2) a supportive pilot sits prin- 
cipal. 3) a sense of teacher ownership, and 4) (a negative influence) changing 
central office leadership. Continuation and expansion indicate a strong 
commitment to the project and belief among the teachers that TV is useful. 
The lack of student achievement data appears not to concern educators, who 
appear to be focusing more on staff development (in its broadest sense). 
Therefore, educators may wish to assess impact on teachers more closely in the 
•1983-84 school year. 
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Frederick County > Frederick County has been implementing TV for two 
years using a pilot district strategy. The status of project objectives was 
not specified for September 1982. In June 1983, educators "hoped" to inform 
local educators about the model and train them to use it. They had "partly 
achieved" improving teachers' classroom competence, helping teachers become 
better organized, and improving time-on-task. One objective, ensuring a match 
between instruction, curridulum, and tests was "achieved." The remaining two ' 
objectives specified in Table 42 were not given a status. 

• Scope and Intensity . After" the" first year of TV * 
implementation (June 1982), TV was being used in one middle 
school/high school by 12+ teachers in a variety of subject 
areas. In June 1983, 15 teachers, and 600 students were - 
involved in the project. Educators were mostly implementing 

^the time variable, although two of the survey respondents said 
that^they were also implementing the content variable. Both 
teachers and administrators were observers,., although the 
former were primarily responsible for TV. Data feedback and 
strategizing for improvement (if needed) were carried out on 
au individual basis. , * ' 

• Time. Educators spent 'an average of 5 months involved in 
SITIP across the 1982-83 school year. Teachers reported 
spending an average of 11% of their school week on TV-related 
activities (e.g., ob,servation and a',5plication of strategies to 
increase time-on-task during the course, of instruction ..ia the 
subject areas selected). 

The central office staff respondent reported spending t^n days 
on TV, which was "dbout the same" amount of time and energy in 
comparison to similar previous projects. Educators, c^in 
general, indic-ced that TV did hot require teachers to spend 
more timef^ preparing students (e.g., 2:::ouping, pre-testing) , 
and that TV did not allow teachers to cover the curriculum in > 
a shorter period of time. . o 

.. ^ i- 

• Roles and Responsibilities . Centtal office staff spent no 
time and energy on materials development and the most, effort 
ou administration and evaluation (4.00 on each activity);* 



* Level of effort (time and energy) was rated on a scale from 0 (none) to 
5.00 (a great deal) . , c 
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Most of the training of teachers was done by school-based 
staff. Educators rated the Interactive support received by 
the five role groups Involved in TV as average (3.00) and 
above, with the following (below average) exceptions — 
teachers' ratings of support from school administrators 
(2.91), from central office staff (2.27), from MSDE (2.82), 
and of developers (2.55); and central office ratings of 
support from MSDE (2.00) and from developers (2.00). Teachers 
received the highest overall ratings (3.67) and central office 
the lowest (2.33). By June 1983, 52 teachers in the pilot 
school had received information about TV, and seven teachers 
had received training and help . One "other" faculty member at 
the pilot school had also received training . 

Impact . TV has had an impact on training and on the school, 
educators, and students involved. In the area of training , 
5A.5% of the teachers felt that they understood the model. 
Thirty-six percent indicated that their teaching ability had 
improved as a result of TV while the same percentage said that 
it had not. 

At the school level , TV involvement has enabled educators to 
become more effective in classroom management , to share ideas 
with other educators, and to learn new instructional 
techniques. 

Central office staff reported that TV enabled them to learn a 
new strategy to Improve teaching. 

Educators indicated that TV has 'had an impact at the class - 
room level in terms of better organization and more attention 
to academic content. Teachers increased their knowledge/ 
awareness of time-on-task, and the research on effective 
teaching, and their ability to distinguish between classroom 
procedures which are or are not effective. They improved 
their skills in a new teaching/observation technique and in 
classroom management. Teachers also strengthened their 
attitude about teaching. 

Increased student achievement was not perceived to any 
significant extent by educators. However, students did . 
improve their awareness of classroom behavior and time-on- 
task, enjoyed TV, and were less disruptive. 

Concerns and Changes . Educators were concerned about the lack 
of a research base for TV at the secondary level. Some 
educators did not agree with some of the coding categories. 
They also did not like having La^iaave. their classes with 
substitutes while they observed. They were concerned that, 
observers were not monitored (peer crj^dibility) , and they felt 
that they did not have enough time to implement TV. 



270 

289 



Educators recommended that more time be provided for strate- 
gizing. and for paperwork, that new leadership be assigned to 
the project, and that teachers should not/ be expected to 
implement a new program such as TV on top of other new LEA 
priorities. Other suggestions made Included dropping the 
program altogether and engaging in more /sharing/networking 
with other counties. / 

/ 

Factors influencing the relative success of the project Included: (1) 

. / 

conflicting priorities of central office staff; (2) use of two classroom 

/ 

observation methods (TV and another) with somewhat different purposes; (3) 

/ 

teacher's discomfort with some coding definitions, and with observation 

arrangements which reduced the perceived value of the model; C4) teachers* 

perceptions of support received (below average); and (5) very little evidence 

of impact on teachers and students. These factors reflect both on the model 

and on the strategies and procedures used to carry out implementation. Local 

educators may need to review the extent to which they believe that TV can help 

them achieve objectives they consider important, and subsequently modify their 

activities. , 

• Kent County . Kent County has been implementing TV for two years using a 

lighthouse schoo] strategy. In September 1982, one objective, ensuring a 

match of instruction, curriculum, and tests was "hoped for." In June 1983 

with the addition of thre?. schools, only two objectives remained "achieved" — 

informing local educators about the mod^l and training educators to use the 

model. One objective — improving achievement in the basic skills — was 

"partly achieved". Ensuring a match between instruction, curriculum, and 

tests was no longer considered an objective and the remaining five objectives 

were "hoped for." 

• Scope and Intensity . After the first year of implementation 
(June 1982) , TV was being used in one elementary school by 
eight teachers in reading/language arts. In June 1983, TV had 
expanded to three other elementary schools. Thirty-two 
. teachers and 676 students were iu^olved in TV.. Educators 
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were Implementing the time variable. ObservationB, were done 
by principals and supervisors who carried out data feedback 
and strategizing for improvement on a one-on-one basis. 
Sixty-five percent of the teachers reported not needing to. 
make changes in their classroom management after time-on task 
analysis. 

© Time . Educators spent an average of 8 months on SITTP across 
the 1982-83 school year. Teachers reported spending an 
average of 32% of their school week on TV-related activities 
(e.g., observation and application of strategies to increase 
time-on-task during the course of instruction in the subject 
areas selected) . 

Central office staff spent an average of 12.5 days and school 
administrators an average of 7 days on SITIP. SITIP took 
"about the same" amount of time and energy for both central 
office and school administrators as had. similar previous 
projects. Educators, in general, indicated that TV did not 
require teachers to spend more time preparing students (e.g., 
grouping, pretesting) and that TV did not allow teachers to 
cover the curriculum in a shorter period of time. 

• Roles and Responsibilities . Central office staff and school 
administrators combined spent the least amount of time and 
effort on dissemination (1.20)* and the most effort on 
administration (1.80). Central office spent the most time on 
supporting school implementation and dissemination (2.50 for 
each activity) and the same amount of time (2.00) on each of 
the remaining five activities. School administrators spent 
very little time on dissemination (.33) and the most effort on 
administration (1.67). , 

ftost of. the training of teachers was done by central office 
staff.' Administrators and supervisors were trained by 
developers and MSDE. Educators rated the interactive support 
received by the five role groups involved in TV as average 
(3.00) and above, with the exception of teachers' ratings of 
support from developers (2.76). School administrators 
received the highest ratings of support, and developers the 
lowest ratings. By June 1983, information had been received 
by all central office staff by about 75% of the school 
administrators and by 25% of the teachers. Training had been 
received by 50% of the central office staff, by 75% of the 
school administrators, and by 25% of the teachers. Fifty 
percent of the central office staff and 25% of the school 
administrators and teachers had received help . 



* Level of effort ( time and energy) was' rated on a scale from 0 (none) to 
5.00 (a great deal). 
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Impact . TV has had an Impact on training and on the schools, 
educators, and teachers involved. In the area of training , 
65% of the teachers understood the model* Sixty-^five percent 
indicated that their teaching ability had not changed as a 
result of TV, suggesting that engagement rates./ were already 
high for many of the teachers. / 

/ 

At the school level , time-on-task increased, educators gained 
a new perspective on some possible reasons f/or student 
learning problems and worked together toward a common goal, 
and the schools gained recognition for their participation in 
the SITIF project. / 

Central office staff and school administrators" reported that 
TV enabled them to learn a new observational technique. 

Educators indicated that TV has had an impact at the 
classroom level In terms of clear teacher expectations. 
Teachers increased their knowledge/awareness of the types of 
classroom procedures which are or are/not effective, and 
improved their skills in a new teaching/observation technique 
and in classroom management. They a/lso strengthened their 
attitudes about teaching and about £he importance of keeping 
students on task. ^ - 



Increased s tudent achievement was .evidenced to some extent in 
test scores. Affective student impact was felt in terms of 
improved attitudes or awareness ^bout classroom behavior and 
time-(f>n-task and of the value oy being organized. 



» Concerns and Changes . Educators expressed both model-specific 
conce'rns (i.e., disagreement with some of the coding catego- 
ries,' teacher apprehension about observations, the amount of 
time 'and paperwork involved) y^and implementation concerns 
(i.ej, lack of knowledge abc^ut why the project was being done • 
and ^ general negative attitude and apathy among some of those 
involved). Recommendations fell into three categories: 
implementation (i.e., impl^ement the content variable, do not 
begin implementation during the first few days of school); 
involvement (i.e., teachers must see the value of the program, 
. drop the program altogether); and expansion (i.e., increase 
the number of people involved). 



Factors influencing relative success included: (1) some initial uncer- 
tainty about desirable scope and intensity and how responsibilities should b 

. ° / ■ 

shared; (2) teachers' resistance, which has been reduced but still exists in 

"pockets," partly due to a lack of understanding o^ the project or of its 

/ / . ■ I ^ ' 

value; (3) gradually growing commitment to TV, reinforced by some perceived 

/ h 

success. If teachers became better informed about jthe model and understand 
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the potential benefits of its use in the community, TV could become success- 
fully integrated into classroom supervision practices. At present, it appears 

to be moving toward that point but still needs energy invested in interactive / 

....... / 

support and in . demonstrating worthwhile impact. / 

Montgomery County . Montgomery County has been implementing TV for two / 

/ 

years using a lighthouse school strategy. In September 1982, the elementary 
school involved in the project* had "achieved" one objective — improving / 
achievement in basic skills, had chosen not to address "informing and training 
other educators," and had "partly achieved" die remaining objectives specified 
in Table 42. In June 1983, all the "partly achieved" objectives were j 
"achieved" with the exception of improving student achievement in noii^basic 

skills subjects which remained "partly achieved". Informing educators about 

./ 

the model, which was not given a status in September , , was ''achieved^" by June. 

Improving achievement in basic skills was "partly achieved" in Juntp:. 

// 

In September 1982, the middle school "hoped" to achieve two^objectives 

/ 

(i.e., training educators to use the model and ensuring a match /between 



instruction, curriculum, and ^tests) . Improving students' involvement in 

learning was not considered to be an objective. The remaining six objectives 

specified in Table 42 were "partly achieved." In June 1983 all eight . 

applicable objectives had been "achieved". 

• Scope aiid Intensity . . After the first year of Implementation 
(June 1982), eleven teachers were using TV in 2 schools (one 
elementary, one middle) in reading/language arts and mathe- 
matics. In June 1983, TV had expanded to include 11 teachers 
and 470 students. In the elementary school. Active Teaching 
(AT) was also being used to improve time-on-task. The 
teachers responding to the survey indicated that they were 



* The two sites implementing TV in Montgomery County submitted two separate 
Key Contact Questionnaires specifying different objectives. 
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implementing both the time and content variables. For the / 
content variable 100% of the teachers matched the curriculum, 
instruction and tests, knew what students had been taught / 
previously atid their test scores, and modified the curriculum 
and/or instruction when necessary. For the time variable, 
fifty percent of the teachers said they had been observed by 
other teachers and '50% by principals. They all said that they 
strategized during staff meetings and 83% made changes to 
improve time-on-task with 67% indicating that time-on-task had 
improved as a result of these changes. 

• Time . Educators spend an average of 10 months of SHIP across 
the 1982-83 school year.* Teachers reported spending an aver- 
age of 24% of their school week on SITIP— related activities 
(e.g., obsexrvation and application of strategies to increase 
tlme-on-task during the course of Instruction in the subject 
areas selected). 

Central office staff spent an, average of 16 days on SITIP 
which was "slightly more" time and energy in comparison to 
similar previous projects. The school adralnist^rator spent 
"substantially more" time and effort on SITIP./ Educators, in 
general Indicated that TV required teachers to' spend slightly 
more time preparing students (e.g., grouping ,^^pre-testing) and 
did not feel that TV allowed teachers to cover the currlculm 



in a -shorter-period "of "" tiffle"; ' 

Roles and Responsibilities . Central office^ staff and school 
administrator's combined spent the least am'ount of time and 
effort on evaluation (1 .33)** and the most effort on adminis- 
tration and supporting school implementation (3.67 for each 
activity). Central office staff spent r/o time on evaluation 
and "some" to "quite a lot" of time on administration and 
supporting school implementation (3. 50 /for each activity). 
The school administrator spent the lea^t time on dissemination 
(2.00) and "quite a lot" of time (4.0^6) on each of the 
remaining five activities — administration,. raaLerlals 
development, inservlce, supporting school implementation, and , 
evaluation. y 

Most of the training of teachers was done by the developers 
and school-based staff. Educators rated the interactive 
support received by the five role"^ groups Involved in TV as 
average (3.00) and above with th^e following exceptions: 
school administrators' and teac^hers' ratings of central office 
support (1.00 and 1.67 respectively); and teachers' ratings of 
support from MSDE and develope^rs (1.83 for each role group). 



* 



Central office staff and the elementary administrator and teachers were* 
involved with more than one model. 

** Level of effort (time and energy) was rated on a scale from 0 (none) to 5.00 
(a great deal) . ' / 



Central office had the lowest and teachers the highest ratings 
of support. By June 1983, information and training had been 
received by all school administrators and teachers at the 
pilot schools, and by about 10% of central office staff and 
"other" faculty. Help had been received by all school 
administrators, by 50% of the teachers and 10%' of the "other" 
faculty at the pilot schools. ' 

d Impact . TV has had an impact on training and on the schools, 
educators, and students involved. In the\area of training , 
83% of the teachers felt that they understN^od the model and 
67% said that they would like to learn morey. None of the 
teachers indicated that their general teaching ability had 
improved as a result of TV. \ 

At the school level , time-on-task has increased and educators 
have learned to use a new teaching/observation\method. 

School administrators reported that involvement \ln SITIP has 
given them the self satisfaction of applying an effective 
technique. \ 

Educators indicated that TV has had an impact at the class- 
room level , in terms of providing a more complete \ 
instructional program-. Teachers increased their knowledge/ 

_ awareness, of .learning theory , and improved their skills in .a'_ 

new teaching/observation technique and in assessing scudent 
behavior/attitudes/needs. \ 

Increased student achievement was perceived by teachers in 
test scores. Affective student itapabt was felt somewhat in 
terms of student enjoyment. Also, since some students ©aw 
video tapes of themselves which they discussed using TV coding 
concepts, responsibility for learning appeared to increase, 

o Concerns and Changes . Educlitors were concerned about the\ 

complexity of the model which makes it difficult to implement. 
Recommendations fell into two categories: implementation \ 
(i.e., provide more specif ic ideas for improving instruction); 
and external assistance (i.e., increase state funding, more\ 
central office support). \ 

Factors influencing relative success included: 1) strong comraitpent by 
the principals who used TV to support other school priorities; 2) strategizing 
in staff meetings which allowed teachers to share their expertise; 3) rein- 
forcement of TV with other related research-based information accessed by the 
principals. .Within the two piilot schools TV has been used well as a mecnanlsm 
for professional development, has influenced classroom management, and reduced 
"teacher ""isolation. " ' . . .. ... \.. 
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Somerset County > Somerset County has been implementing TV for two years 
using a lighthouse school strategy. In September 1982, a^ll nine objectives 
specified in Table 42 were "hoped for." In June 1983, four had been "partly 
achieved" (i.e.. Improving achievement in basic skills/and in other subiect 
areas; ensuring a match between instruction, curriculum, and tests; and 
Improving students' involvement in learning), and th/ remaining five were 
"achieved" . 

Scope and Intensity . After the first year of implementation 



(June 1982), two teachers were using the .time variable in 



one 



elementary school in reading/language arts. In June 1983, 
eight teachers were using TV with 217 students in reading/ 
language arts and mathematics. Most of/ the time-on-task 
observations were done by the principal* and/or central office 
supervisor. Teachers strategizing during staff meetings'. 
Eighty percent of the teachers reported making changes to 
improve time-on-task and 80% indicated that time-on-task did 
improve. Principals in other schools were trained in TV by 
the pilot school principal and MSDE staff, and some have 
observed classes using TV techniques. 

Time . Educators spent an average of nine months on SITIP 
across the 1982-83 school year. Teachers reported spending an 
average of 49% of their school week on TV-related activities 
(e.g., observation and application of strategies to increase 
time-on-task during the course of instruction in the subject 
areas selected) . 

The school administrator did most of the time-on-task 
observations which consisted of thr^e observations of each 
teacher at the beginning and end of the school year. He also 
helped train other principals and central office staff on how 
to use the observational technique. He reported that 
"substantially more" time and energy had been spent on TV in 
comparison to similar previous projec.ts. .Most of his time was 
spent on administration, supporting school implementation, and 
dissemination (5.00 for each activity).* The least effort 
(none at all) was spent on materials development 

Most of the training of teachers was done by MSDE. Educators 
rated the interactive support received by the five role groups 
involved in TV as average. (3^00) and above. Teachers and 
school administrators receiveid the highest ratings and 



[ 

level of effort (time and energy) was rated on a scale from 0 (none) to 5.00 
(a great deal) . 
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.developers the lowest ratings of support. By June 1983, all 

school administrators (and teachers in the pilot school) had 

received information , training and help . Seventy-five percent 

of the central office staff had received information and • - 

training and 100% had received help . 

• impact . TV has had an impact on training and on the schools, 
educators, and students involved. In the area of training , 
75% of the teachers reported that they understood the model 

• and 50% said that their teaching ability had improved as a 
result of their involvement in SITIP. 

At the. school level , TV has enabled educators to improve 
specific categories of instruction. Educators also felt that 
they benefitted from the use of pre and post tests to measure 
growth. 

Central office staff and school administrators have leatned a 
new observational technique. 

Educator^ indicated that TV is a worthwhile, workable instruc- 
tional model. Teachers increased their knowledge/awareness of 
time-on-task, and improved their skills in controlling time- 
on-task. 

Increased student achievement has been perceived in test 
scores. 

Affective student impact was perceived in terms of improved 
attitudes or awareness about classroom behavior and time-on- 
task. 9 

• Concerns and Changes . Educators felt that the TV was more 
useful for new' teachers than for experienced teachers, and 
that it requires too much time and/or paperwork. Educators 
recommended that TV should not be used with every teacher, but 
that it should be expanded to involve those teachers that 
needed to improve their classroom management techniques. 

Factors influencing relative success included: 1) the pilot principals' 

interest in using TV; 2) teachers' approval of a series of brief observations 

instead of a single longer observation; 3) the increased student engagement 

rate from pre to post observation^af ter teachers had improved time management 

skills. However, few teachers had low engagement rates to begin with, which 

influenced the recommendation that TV should not be used with all teachers. 

It appears that TV was accepted by /local educators » and helpful for some 

/ 

teachers in improving classroom management. 
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Talbot County , Talbot County has been implementing TV for one year using 



a lighthouse school strategy. New LEAs were not required to specify their 
objectives in September 1982. In June 1983, educators had "partly achieved" 
three objectives (i.e», training educators to use the model, ensuring a match 
between instruction, curriculum, and tests, and helping teachers become better 
organized). The remaining six objectives specified in Table 42 were "hoped 
for". ^ ^ V 

• Scope and Intensity . After the first year of implementation 
(June 1983), TV was being used in one vocational-technical 
school by four teachers and 80 students in auto mechanics, 
masonry, carpentry, and agriculture. Teachers were imple- 
menting the time variable. The majority of the teachers 
reported being observed by the principal. They strategized 
during staff meetings. Fifty percent of the teachers, reported 
making successful changes to improve cime-on-task. (Since TV 
was not designed originally for these kinds of classes, MSDE 
provided additional related infonnation from the R&D Center 
for Vocational Education and lo^al educators reviewed 
modifications with the TV devel<»per.) 

© Time . Educators spent an average of 8.5 months on SITIP 
across the 1982-83 school year. The school administrator 
reported spending 30 days, and central office staff 14 days on 
TV. This represented "slightly less" time and energy in 
comparison to similar previous projects. Central office staff 
and school administrators combined spent the least amount of 
time and energy on dissemination (1 .00)* and the most effort 
on inservice and supporting school implementation (3.00 for 
each activity). The school administrator spent the least time 
on dissemination and evaluation (1.00 for each activity) and 
the most effort on inservice (5.00). The central office staff 
respondent spent the least effort on materials development, 
inservice and dissemination (1.00 for each activity) and the 
most time and energy on administration and supporting school 
implementation (3.00 for each activity). 

Most of the training of teachejs was done by the developers 
and MSDE. Educators rated the interactive support received by 
the five role groups involved in TV as average (3.00) and 
above with the exception of the school administrators' ratl-^ 
of central office support (2.00). MSDE received the highest 
and central office the lowest ratings of support. By June 
1983, about 23% of office staff, school administrators, and 
teachers at the pilot site received information , training , and 
help . 



* Level of effort (time end energy) was rated on a scale from 0 (none) to 5.00 
(a great deal) . 
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• Impact , TV has had an Impact on training and on the schools, 
educators, and students involved. In the area of training , 
67% of the teachers reported that they understood the model, 
however, 67% said that they would like to learn more. 

At the school level, educat ors have become aware of a new 
instructional/observational technique and have strengthened 
their awareness of the importance of good teaching. Central 
office staff and school administrators have learned a new 
instructional/observation strategy and have realized the need 
to structure time well. 

Educators indicated that TV is a worthwhile, workable instruc- 
tional model. Teachers have improved their skills in a new 
teaching/observation technique in assessing student attitudes/ 
behavior/needs, and in controlling time-on-task. They have 
strengthened their attitudes about teaching and about the 
importance of keeping students on task. 

Educators were unsure about whether student achiev ement 
increased as a result of TV. However, students did improve 
their attitudes about learning and school. 

• Participant Concerns . Educators were concerned about the 
amount of tim^i and/or paperwork required to implement TV. 
RBCoimnendations included implementing the content variable, 
increasing central office and MSDE workshops, and dropping the 
program. 

Factors influencing relative success included: (1) alignment of local 
priority with TV; (2) learning fr .iL ..ther TV projects' experience used in 
planning for implementation; and (3> anticipation of problems (e.g., elemen- 
tary vs. secondary knowledge base) and use of strategies to avoid negative 
impact. For their first year, Talbot educators appear to have made good 
progress. 

Summary and Conclusions 
The four preceding sections of this chapter each focus on local implemen- 
tation of one of the models: Active Teaching (AT), Mastery Learning (ML), 
Student Team Learning (STL), and Teaching Variables (TV). This section 
examines implementation across all four models under the following headings: 
planning, scope and intensity of implementation, time spent and responsibili- 
ties shared, impact, and participant concerns. 
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Planning 

Table 50 presents the status of objectives in June 1983 across all of the 
SJTIP projects. The objectives can be divided into four categories: student 
Impact (objectives 1, 2, and 9); training (objectives 3 and 4); teacher Impact 
(objectives 5, 7, and 8); and curriculum alignment (objective 6). The level 
of achievement varied across the four categories, with the highest level in 
curriculum' alignment followed by training, teacher Impact, and'student Impact. 
These results are strongly Influenced by the amount of time and effort that 
educators spent on the objectives. For Instance, educators have been working - 
on curriculum alignment for Project Basic since 1979 and so have a sound 
foundation on which to build. Local achievement of training objectives wa^ 
influenced by the fact that provision of Information and training for STTTP 
began in 1980 and has been strongly reinforced by both MSDE and LEA activities 
since that time. Changes in teachers' behavior have arisen from that 
training, and achievement of objectives in this categ;ory was strongly 
influenced by the interactive support provided by LEA team members. The. three 
objectives relating to Improvement in students' achievement and attitudes can 
only be achieved after the othfer categories of objectives have been 
accomplished. These findings reinforce those of other school improvement ^ 
studies which have found that major changes affecting, students take from three 
to five years to bring about. \ 
Scope and Intensity of Implementation 

During the 1982-83 school year, all 24 school districts were involved in 

SITIP, 20 implementing a single model, three implementing two models, and one 

1 

Implementlr.i^ three models. Table 51 summarizes the scope and intensity of 
SITIP implementation ^as of June 1983. i 
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Table 50 

Status of Objectives: All Models, June 1983 



2 = Partly achieved 

3 = Achieved • 



V 


Local Objectives 


Number ( 
Addressli 


Df Projects 
Objectives 


Status** 






Total 


AT 


ML 


STL'* 


■'TV ' 


% of Pro- 


ects 






N=29 


N=7 


N='7 




N^7 


1 


2 


J 


1. 


Improve student achievement (basic skills). 


26 


6 


7 


■6 


7 




jU 


27 




Improve student achievement (other subjects). 


22 


3 




7 


6 


45 


45 


10 


3. 


Inform local educators about model. 


27 




7 
1 


7 
/ 


7 


U 


33 


56 


4. 


Train educators about model. 


26 


5 


7 


8 


6 


4' 


61 


J J 


5. 


^ Lwvc LCduners ciassroom competence* 


29 


7 


■ 7 


8 


7 


3 


59 


38 


6. 


Ensure match of instruction, curricnluni 
and tests(s). 


18 ' 


I 


■'7 


4 


6 


0 


39 


61 


7. 


Help teachers become better organized. ' 


27 


6 


7' 


7 


7 


4 


66 


30 


8. 


Improve time-on-task. 


.25 


6 


7 


5 


7 


8 


56 


36 


9. 


Improve students' involvement in learning 
(motivation). 


23 


6 


5 


7 


;5 


13 


48 


39 
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Table 51 

Scope and Intensity By County: All Models, June 1983 

T 




Topics: AT-Actlve Teaching 
ML««Mascery Learning 
STL-Student Team Learning 
TV»Teachlng Variables 



Type: E-Elementary 

J/M-Junior high/middle 
H-High school 
0-Other 



Strategy: LS-Li«hthouse school 
/ PD-Pllot district 

DW«Dlstrlc't-wlde 
CB«Capaclty building 
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Projects , There were six AT projects, seven MT^ projects, nine STL 
projects, six TV projects, and one combined AT-TV project for a total of 29 
SITIP projects across the state. 

Strategies , LEAs selected one of four implementation strategies: (1) 
district-wide, (2) pilot-district, (3) capacity building; and (4) lighthouse 
school. The lighthouse school strategy was the most popular (16 projects), 
followed by pilot district and capacity building each used for five projects, 
and district-wide used for three projects. 

For AT, two projects had a district-wide strategy, two had lighthouse 
schools, one had a pilot-district, and one a capacity building strategy. For 
ML., there were six lighthouse school projects and one pilot-district project. 
For STL, four projects had capacity building strategies, three had lighthouse 
schools, and two had pilot-districts. For TV there were four lighthouse 
school projects, one pilot-district project, and one district-wide project. 
The combined AT-TV project used a lighthouse school strategy.. 

During the first 18 months of SITIP — - ending June 1982 — it was found 
that: " 

The implementation strategy determines how the work is shared 
among role groups, and how the burdens shift among role groups 
over time. The implementation strategy plus the scope (number 
of schools, teachers, curricular subjects', grade levels, and 

amount of time for the innovation to be used for each class or 

srhject) determine how much work is to be done within a given 
U.\. (Roberts, et al,, 1982) 

_ Activities during the 1982-83 school year continue to support these 

findings. Also, there is a relationship among the implementation strategy 

used, the nature and extent of central office staff involvement, and the 

extent to which the model(s) used are perceived by central office staff to fit 

LEA priorities. For instance, the district-wide strategy required central 
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coordination and considerable central office staff Involvement, and was used 
where the model fit closely with a local priority. The pllot-dlstrlct 
strategy was not quite as demanding and (with the exception of two LEAs) was 
used where the model fit local priorities.* The lighthouse school strategy, 
Implemented as designed at all sites, required a fit between the model and the 
school's priorities (not necessarily the district's priorities), and central 
office administrative support. Expansion occurred beyond the lighthouse site 
only when: (I) there was impact on student achievement; (2) teachers liked 
the model; and (3) central office staff provided additional support (usually 
to make the necessary arrangements for staff in other schools to attend 
training). The capacity building strategy was centrally coordinated in <two 
LEAs and school-based at three sites, with a fit between the model and LEA 
priorities at only one of the latter. The greatest weakness of this strategy 
was that once teachers were trained, in most cases they had high autonomy and 
low interactive support (reflecting low involvement of central office staff) , 
and the fidelity and frequency of implementation was not as great as for other 
strategies. 

These findings suggest that the closer a model was to existing LEA 
priorities the more likely it was to draw central office involvement, and sub- 
sequently lead to strong and widespread classroom use. Conversely, when the 
model did not fit a district priority, it could be well implemented in a 
school where it fit that school's priorities but was not likely to be widely 
used, and its survival depended more on the individual teachers involved. 
Implementation strategies initially selected by LEAs reflected the amount of 
energy and commitment of local educators which was based on the fit ^- as they 



* In both cases (of exception) the model as implemented did. not support local 
priorities: expansion was curtailed and central office support was low. 
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perceived it — between the model and their priorities. If, subsequently, it 
became apparent that the fit was greater or smaller than at first perceived, 
the strategy was changed (e.g., Kent County changed from a lighthouse to a 
district -wide approach when central office staff decided that the model fit 
one of their priorities) . 

Schools, teachers, and students . Over 986 teachers and 34,955 students 
in 139 elementary and secondary schools v^ere involved in SITIP. The approxi- 
mate number of schools, teachers, and students involved in each model is 
presented in Table 52. Of the 139 schools involved, 65% were elementary, 34% 
were secondary, and 1% were "other'' (i.e., K-12, vocational-technical). 
Fifty-two percent of the schools, 58% of the teachers, and 69% of the students 

in SITIP w^ere using the AT model. This high degree of AT implementation was 

/ 

influenced by the strategies selected by the LEAs which, in turn, were 

influenced in part by the model's relatively low complexity. However, of 

greater/ influence was the fit of the model to local priorities;' the model was 

/ - . 

perceived as a viable instructional method (particularly for mathematics). 

/ ' , , . ' 

Across the entire state, more than 11% of the schools were involved in 
/ •' ■ ; ' 

STTIP (AT ~ 6%, ML ~ 1%, STL 3%, TV ~ 1%). 

/ ■ . * . ^ . • 

/ Fidelity . Fidelity relates to the extent to which teachers implemented 

the models as designed. AT, required the implementation of six components, MI. 

required ten components, and STL five components (see Chart 10). For TV, 

e^^ucators could implement the time variable in a variety of ways. 

/ AT had the greatest fidelity, with 72% of the teachers implementing all 

six components, as compared to ML where 23% of the teachers carried out all 

ten^. components, and STL where 33% of the teachers carried out the five 

required components. For AT, no single component was addressed by less than 

88% of the teachers, as compared to ML (51%) and STL (76%). 
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Table 52 



Scope and Intensity Summary: All Models, June 1983 



Models 


Pro 


ects* 


Schools** 


Teachers 


Students 


// 


% 




% 


// 


% 


// 


% 


Active Teaching 


7 


24 


72 

^ E 52 
S 20 


52 


' 572 


58 


24,037 


69 


Mastery Learning 


7 


24 


13 

E 4 
S 8 
0 1 


9 


203 


21 


4,603 


13 


Student Team 
Tjeafn inp 

i 

1 


8 


28 


42 

E 28 
S 14 


30 


113 


11 


3,732. 


11 

/ 


Teach' -> Variables 


7 


24 


12 

E 6 
S 5 
0 1 


9 


98 


10 


2,583 


7 


Total 


29 


100 


139 

E 90 
S 47 
0 2 


100 


986 


100 


34,955 


100 



* Although Prince George '.s County implemented STL in about 10 schools, no, 
*'hard** data were available at the end of the school year. Therefore, 
this LEA is not included in thes^e results. 



** One school is implementing two projects — AT and TV, It is counted once 
under TV, 

Schoo ls ; E = Elementary . . : 

S = Secondary 
0 f Other 
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Chart 10 

SITIP Fidelity of Iinpleiiientatlon: 1982-83 



Models and Components of Student Team Learning* 



STAD Is liDplemented. 
TGT Is Implemented » 
Jigsw is Implemented. 
TAI.h implemented. ' 

Each team includes a mix of kinds of students 
(on given criteria). 

Materials are available for peer tutorJng, 
team practice, and individual- and tournament 
quizzes. 

(Juiz/tournament scores relate to individual 
and team achievement. 
Peer tutoring takes place a great deaL 
Successes are publicized. 



Teachers Implementing^ 



HI 

0 



Components of Mastery Learning 



1. (Objectives are specified. 

2. Objectives are broken down into component 
. skills. 

3. Curricula (texts, materials) are matched to 
objectives. 

4. Instruction given matches curricula and 
objectives. 

5. Tests match objectives. 

ft. Tests include Items from both lower and 

higher order thinking skills. 
1- A "no fault" formative test is given for each 

uaic. 

f. "Corrective" and ''enrichment" activities are 
given after formative tests. 

9. Suim,nivo tests are given at the end of each 
unit. 

in. Records are kept pt ■ class per student per 
objective on level of mastery. 



37 
28 
15 



59 



52 

5! 
52' 



59.7 
«.2 
24.2 

0 
0 

95.2 



B3.9 

75.8 
82.3 
83.9 



Teachers Imolemcntin^ 



N=48 



43 

38 

37 

42 
46 

35 

,40 

47 

47 

25 



89.(i 

79.2 

77.1 

87.5 
95.8 

72.9 

83.3 

<)7.9 

97. «l 
52.1 



Variables and Components of Teaching Variables 



The "content" variable Is implemented. 
The "time" variable is /implemented. 
Other teacher{s) have / collected time-on-task 
data, observing me. ' 

My principal (or vice-principal) has collected 

tlme-on-task data, observing ite. 

A central office supervisor collected tlne-on- 

task data, observing me. 

Data collected on/ny class Indicated that tioe- 

on-cask was such/tha'. I did not need to make 

"changes. j 

Observation resiits are discussed in staff 

meetings and we help each other find strategies 

to improve ttme-on-task. 

1 have made changes in ray class to improve 

tirae-on-usk'. 

Data collected on ray class indicated that tlne- 
on-task improved. 



/ 



/ 



Components of Active Teaching 



Pre-lesson development. 
Lesson development. 
Controlled/guided practice. 
Independent practice. 
Homework assignments, 
Reviews. 



eachers Impleaentlng 



N=47 



14 
29 

27 

34 

23 

22 

21 
24 
17 



X 



29.8' 
61.7 

36.2 

72.3 

48.9 

46.8 

44.7 
51.1 
36.2 



Teachers Inplementlng 



N=57 



51 

53 
50 
52 
52 
51 



89.5 

93.0 
87.7 
91.2 
91.2 
89.5 



For Student Team learning and Teaching Variables, unnumbered itcn^ ropres 
or variables, 



sent specific nodcls nr variables. Implementers could use any one or all mod 
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/ For TV, the majority of the educators (62%) Impleraented the time 

variable. Most of the teachers (72%) had been observed by principals and 

/ ■ 
vice-principals, and 45% reported strategizing during staff meetings. Fift 

one- percent made classroom changes to improve time-on-task and 36% reported !an 

improvement in student engagement rate. 

Time Spent and Responsibilities Shared .... 

This section summarizes the amount of time spent on SITIP activities fot 

/ \ 

all four models by each role group during the 1982^^83 school year. \ 

\ 

Teachers' use of time . The average number of months' involvement by \ 
teachers for three models (AT, ML, TV) was eight months, with no one involved ^ 
for less than five months. AT implementation was /continuous for the specified 
number of months. With tKe exception of some ML sites, teachers did not use 
ML and STL continuously during those months, but used them for specific units 
of instruction. TV teachers were usually observed at the beginning and end of 
the time, applying improvement strategies in the interim, if appropriate. 
During the period that teachers were direccly involved, the average time spent 
during a given week ranged from 21% (STL) to 39% (AT). For three models (AT, 
ML, STL) elementary teachers spent less^ time (15% to 23%) than did secondary 
teachers (23% to 51%). This reflected the fact ^that elementary teachers used- 
a model for only one or two curricular subjects, while anyVsecondar^TeiTcHers 
involved used the model for his/her subject area specialty with a relatively 
large number of classes. For TV, secondary teachers spent 19% of their time 
and 'elementary teachers spent 33% of their time teaching subjects for which 
"time" observations were conducted or the ''content" variable addresp^d. This 
reflected the higher credibility which the TV data base had among elementary 
teachers. 
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In order oi investment of classroom time, models were: AT, ML, TV, STL. 
Investment varied from one site to another, influenced strongly by administra- 
tive decisions and the amount of development work completed in the first year. 
Factors working against high investment of classroom time included: (1) need 
for materials (STL, ML); (2) need for preparation time (ML, STL); (3) pressure 
to cover the curriculum in a given amount of time (ML, STL); (4) relative 
suitability of 3 model to the curriculum (STL) J (5) relative suitability of a 
model to a grade level (TV, secondary); and (6) negative experiences in early 
implementation which were not totally resolved by local administrators (some 
sites for AT and ML, perceived most strongly for TV), factors facilitating 
high investment included: (1) availability of materials (ML, STL); (2) low 
complexity of the model (AT); (3) suitability of the model to a curriculum and 
grade (AT); (4) successful application experienced by teachers early in the 
project (AT, STL); and (5) successful application facilitated by local 
administrative support (all models in some sites, but perceived most strongly 
for STL). 

Local administrators' use of time . The average amount of time invested 
by central office staff and school-based administrators ranged from nine or 
ten ^days for AT and' STL to 23 days for ML. Individual administrators spent as 
few as two days on SITIP to an almost full-time commitment"! WltlTthe 
exception of TV, central office staff spent almost twice as much time as 
school-based administrators. In all cases, combined time of administrators 
was invested least in materials identification and/or development . For three 
models (AT, ML, STL) most combined time was spent on supporting sc\oq1 
implementation and administration . The other three areas of activity — 
inservice, dissemination, evaluation ~ took relatively little time. Since 
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appropriate materials were essential for ML and STL, and since administrators 
invested so little in this activity, classroom use was reduced unless teachers 
already had materials or were given release time for development. Given 
teachers' concerns and needs relating to TV, greater investment in support 
(rather than administration) was desirable at some sites. 

Interactiv e support . This area of activity included both logistical and 
affective support. It was expected that all role groups (teachers, school- 
based administrators, and central office staf f) ' needed to help each other 
achieve success, and that assistance from MSDE technical assistants (TAs) and 
developers was also desirable. Support activities and behaviors included: 
information exchange; training (both traditional inservice and one-on-one 
coaching); provision of materials and other resources; arrangements for 
teacher release time; assistance in development of quality materials, tests, 
record-keeping systems, etc.; acknowledgement and publication of success; and .. 
supportive use of feedback to encourage improvement. Support was rated for 
all role groups by the three local role groups (on a five point scale, l=very 
poor, 5=excellent) , and results are presented for all four models in Table 53. 
Overall ratings range from just above average (3.29) for developers, to very ■ 
good (3.94) for teachers. (Last year, ratings ranged from 3.39 for MSDE to - 
3.78 for school-based administrators.) In general, ratings of loca-r supp^Trc- 
reflect effort invested by a given role group. Ratings of "external" 
assisters are influenced primarily by contact frequency or visibility. For 
instance, since central office staff were more often in contact with the MSDE 
TA for AT, their ratings of his support were higher than ratings given by the 
other two role groups. Also, since STL developers attended follow-up training 
sessions and conducted several on-site workshops, ratings of their support 
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Table 53 

Perceptions of Support Received: All Models, 1982-83 



Support Groups 
Models/ResDondents'^^K^ 




Teachers 


School 
Aaiinistrators 


Central 
Office Staff 


KSDE ■ 


1 

Developers ■ 


Active Teaching 


112 


3.13 ' 


3,83 


3.79 


3.61 


3,24 y 


Hastery Learning 


15 


ill 


3,95 


3,81 


3.64 


i 

3.21 


Student It b earning 


86 


4,12 - 


4.12 " 


3.82 


3.94 


, 3.]2 


Teachine VarkMpq ■ 


Dl 




3.64 


2.98 


3.29 


2.90 


Totals 


33^ 


3.W 


3.90 


3,65 


3.90 


3.29 



Hean ratings, range from a low of 1.00 (very poor) to a high of 5.00 texcellent). 
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were higher than ratings awarded to other developers. Ratings of developers 
for AT and TV are Influenced by other factors. The AT developers provided 
training only for the 1981 orientation and summer Institute. However, for 
subsequent training events the MSDE TA brought In other nationally recognized 
R&D staff whose work supported AT. Some Implementers considered those people 
as developers, and rated them above average. TV developers conducted site- 
specific training and hosted meetings for local participants, but these rarely 
involved teachers alfid thus the developers were rated below average (with 
teachers' ratings lowest).. 

While ratings of developers' support are relatively unimportant at this 
stage of implementation, the somewhat low ratings for central office support 
(below average — 2.98 — - for TV, to 3.82 for STL) are of concern where 
projects are not school-based, and where the LEA expects SITIP implementation' 
beyond a single school. " . f 

Impact 

This section discusses impact for all models on school systems, central 
office^ staff, schools, school administrators, teachers, and student's. 

School systems . As can be seen in Table 54, the most common Impact at 
the district level was the commitment and sharing among educators (reported 
for AT and >fL) which was encouraged by the SITIP design. Also, for two 
models, policies were put lAto practice to facilitate implementation and 
encourage institutionalization. 

Central office staff . Knowledge of a new teaching, or observation 
strategy was noted by central office staff for all models, plus a. icrcwledge- 
ment of AT's influence on improving organization for instruction. (See Table 
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Table 5i 



Impact of Ifflplenentatlon on Administration 
Schools'; and Districts: All Models, 1982-83* 





Impact** 














■I- 

Role Croups and Models 




) 










S 


chool 


systems 


Central Office Staff 


Schools 


School Administrators 






AT 


'Ml 




Iv 


Al 




STL 


TV ■ 


AT 


HL 


STL 


TV 


AT 


HL 


STL 


TV 




Knowledge of a new teaching strategy 

Miuwieujj? ui ciDie-Ou-CaSiC 

Knowledge of effective observation/ 

supervision method/criteria 
Knowledge of learning (theory, practice) 






2 




2 


3 
2 


3 


5 






3 


4 


3 

3' 


5 


3 


2 




Belief in traditional teaching 
• Comltment /sharing among educators 
Continuity/consistency across classes 
Interest/enthusiasm of students/teachers 

(e.g., in subject area) 
Better management, organization or 

instruction 
Appreciation for teachers, recognition 

UL oUCCCSS 

Support (e.g., arranging ccmon planning 

time) for teachers 
Closer monitoring of teaching 


2 


l\ 


i 


1 


2 








■ k 
2 

2 


3 ■ 


2 
k 

3 


3 
3 


2 

2 
2 


2 








Policy to release teachers to train 
others or coordinate project 

Policy to impleflienc for a given subject 
or grades 


3 


1 































Reported In number of LEAs: 
Active Teaching N-7, Hastery Learning N=7, Student Team Learning N«8, Teaching Variables N-6. 



Impact areas reported only when stated by two or more LEAs for a given model. 




Schools , The strongest area of Impact for ML, STL and TV was sharing 
among educators with continuity and consistency across classes being the 
strongest impact for AT. Interest, appreciation, and support were valued, as 
was closer monitoring and better organization for instruction, (See Table 
54.) 

School administrators . Principals and other school-based administrators 
for all models valued new teaching or observation strategies, gained an 
appreciation for teachers' capability (AT, ML), and strengthened their belief 
in traditional teaching (AT). (See Table 54.) 

. Teachers . During the 1982-83 school year, all role groups received and 
conducted, training, with most conducted by MSDE for AT , and most by school- 
based staff for the other three models. Since few teachers were time-on-task 
observers for TV, they received less training than did school administrators 
or central office staff. Training facilitated understanding of the model and 
of ways in which to initiate and carry out planned change. The impact of 
involvement in SITIP, in terms of teachers' understanding the models and 
improving their teaching ability, is summarized in Table 55, with the percent 
of teachers noted for each area of impact for each moidel. The relatively low 
perceived impact of TV may have been influenced by the amount of training, by 
the number of teachers who were found to have satisfactory engagement rates 
(time-on-task) and therefore saw no need to change, and/or by the interactions 
between observers and teachers. 
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Table 55 

Percent of Teachers . Impacted by Involvement: All Models, 1982-83 



Impact 


~^.^lodels 


AT 


ML 


STL 


TV 


teachers 


understanding model 


72 


73 


80 


64 


teachers 
ability 


improving teaching 


66 


64 


50 


28 


■ teachers 
teaching 


seeing no change in 
ability 


13 


16 


27 


36 



Each of the three local role groups rated impact on teachers in terms of 
enjoyment. Increased knowledge, and Increased skills (on a five point scale 
where 5.00 = strongly agree). Responses are summarized in Table 56. Mean 
ratings in all cases indicated that impact on teachers in all areas did occur 

to some extent with greatest certainty among local educators for STL and least 

\ 

for TV. \ 

\ 

More specific kinds of impact on teachers, in terms of increased know- 
ledge and skills and« strengthened attitudes, are summarized in Table 57. For 
each kind of impact for each model, the number of LEAs where that impact was 
found is presented. Since most LEAs hoped that teachers would improve skills 
relating to instruction, impact in that category is particularly important. 
Since each model emphasizes particular activities, comparisons are not always 
relevant. However, the first three skill areas listed in Table 57 are. 
addressed by all four models, and results indicate that a large number of LEAs 
found that teachers made improvements in teaching/observing, classroom manage- 
ment, and assessing and addressing student needs. For three models (AT, ML, 
STL), these results indicate that in 50% or more of the LEAs impact on 
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^ Table 56 



Instructional Impact as Perceived by 
Survey Respondents: All Models, 1982-83 



i 
1 


Models 


I 

Impact on Instruction ; 


AT 
122 


ML 
7fi 


STL 


TV 


Total 
350 


Instructional Value 












Works In claQQmnm 

l8 worth the work it takes. 

Is a worthwhile teaching approach. 


4.47 
4.29 
4.38 


4.35 
4.28 


4.42 

A 1ft 

4.43 


4.00 

J. /J 

•3.79 


4.35 
4.07 
4.26 


Impact on Teachers 












Teachers enlov it 

Teachers have . increased knowledge . 

Teachers have increased skills. 


4.02 
4.08 
4.05 


3.77 
4.08 
4.08 


4.17 
4.14 
4.06 


3.56 
3.60 
3.51 


3.92 
4.01 
3.96 


Impact on Students 












Students enjoy it. 

Students are less disruptive. 
Dtuaents acnievement has increased. 
Students are learning more. 
Students* genera).- behavior is better. 


3.88 
3.88 
3.59 
3.61 
3.73 


4.09 
3.16 
3.76 
3.67 
3.09 


4.37 
3.65 
3.76 
3.60 
3.57 


3.52 
3.11 
3.08 
2.81 
3.08 


3.99 
3.62 
3.58 
3.48 
3,43 


lime 












Teachers spend more time preparing students. 
Teachers lOver curriculum in less time. 


3.09 
3.13 


4.01 
2.51 


3.93 
2.56 


2.69 
2.79 


3.43 

2J9 


Mean ratings range from 1.00 (strongly disagree) to 5.00 (strongly agree). 





AT-Actlve Teaching, HL-Mastery Learning; SE-Student Team Learning; TV=Teachlng Variables 



ERIC 



. Table 57 

Impact of Implementation on Teachers: All Models, 1982-83 



Impact: teachers have... 



N* 



Increased knowledge 

-of components or procedures of effective teaching 
-of tlrae-on-task 

-of curriculum alignment and program 
-of research and learning theory 
-about teaching and. learning through staff 
development/observation 

Improved skills 

-in a nevr teaching/observation technique 

-In classroom management/organization/plarming 

-in assessing and addressing student needs 

-in specific components of effective teaching 

-in effective use of time 

-in use of peer tutoring 

-in working with students (e.g., motivation) 

-in curriculum development 

-in Instruction 

Strengthened attitudes/perceptions 
-about teaching 

-of teachers' confidence or self-image 
-of the value of traditional teaching 
-of the value of specific,. components of effective 
teaching 

-that the larger group must be emphasized 

-of what students can' accomplish 

-of how well students can work together 

-of the Importance of keeping students on task 

-that teachers must teach every day 



Models 



AT 
7 



5 
6 
6 
3 
7 



3 
3 
2 
1 



ML 
7 



4 
3 



7 
7 
3 
A 



6 
2 



STL 
8 



7 
6 
4 



1 
4 



* N is the number of LEAs implementing a given model. 
•AI-Ajtlve Teflchlng; ML=Hastery Learning; STL-Student Team learning;' TV-Teaching Variables 
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teachers reflected the objectives or claims of the model(s) implemented. For 
TV, appropriate impact was weaker (e.g., knowledge of time-on-task in 33% of 
LEriS, skill in effective use of time in 33% of LEAs) , which may be related to 
the fact that 46.8% of teachers did not need to make changes to improve time- 
on-task or may have been influenced by the strategizing for improvement (44.7% 
of teachers were involved in team strategizing). . (See Chart 10.) In general, 
impact on teachers was positive and clearly related to the model(s) 
implemented. 

Students . Impact on students as perceived by local educators is 
presented in Table 56. While educators agree that students enjoy ML and STL, 
they are less certain about other models, and are tentative for all models 
about improved behavior, learning, and achievement. In general, educators 
rate AT and STL as having slightly more impact on students than ML or TV. 

More specific kinds of impact on students, in terms of improved attitudes 
or awareness, increased achievement, and activity benefits resulting from 
better instruction are summarized in Table 58. For each kind of imp^act for ' 
each model, the number of LEAs where that imipact was found is presented. 
Across all models, the strongest areas of impact perceived by local educators 
were: improved student attitudes toward learning and school and about their 
ability to learn; ^increased student achievement as indicated by test scores, 
and mastery and retention of facts and skills; and b enef its derived from 
instruction In a structured, consistent format with a clear understanding of 
teacher expectations. In general, educators offered statements indicating 
that ML, AT, and STL had somewhat more impact on students than TV. 
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Table 58 

Impact of Implementation on Students; All Models, 1982-83 



Impact on Students 



AT 
7 



Models 
7 



STL 
9 



Improved attitudes or awareness 

-about their learning ability 

-about- their learning responsibilities 

-about learning/ school 

-of their strengths and weaknesses 

-about tests 

-about classroom behavior/time-on-task 
-of teacher interest 

-of value of being organized c. 

Increased achievement 

"in test scores 
-in grades 
-in general 

-in mastery /re tent ion of facts, and skills 

-in problem solving and conceptual understanding 

-especially for lower achievers 

Benefitted from better instruction which provides 

-a structured, consistent foinnat 

-a clear understanding of teacher expectations 

-a greater variety of activities 

-effective learning activities 

-a more complete instructional program 

-better use of time/more materials covered 

-opportunity for independent work 

-opportunity to relearn (after "no fault" test) 

-opportunity to advance 

-special benefits for slower students 

-more individualized instruction 

-peer tutoring/working in groups 

-large group instruction 

-more organization 

-more attention to academic content 
-fewer gaps in skill development 
-competition 
-less pressure 
-recognition of success 



5 
1 

4 
2 



4 
4 



5 
1 
1 
4 
1 
1 



3 
8 



4 
4 
2 
3 



3 
\ 



* N is the number of LEAs implementing a given model, 

AT=Active Teaching; ML=Mastery Learning; STL»Student Team Learning; TV=Teaching 
Variables. 
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In some cases, educators* perceptions were supported by data from 
measures- to which students had responded. All 29 projects agreed to collect 
and summarize student data on attitudes and achievement, but relatively few 
actually did so. 

Student attitude data were summarized by projects using either a brief 
questionnaire or a longer inventory (Learning Environment Inventory for grades 
5-12, My Class Inventory for younger students).* Results are summarized in 
tables 59, 60, and 61. 

The questionnaire was used for three models by seven LEAs (2,731 
students). Results were positive for all items at all sites. Students knew 
the difference between SITIP and regular instruction. They found the lessons 
relatively easy, enjoyed and understood them, considered that in comparison to 
regular lessons they were better, and students learned more and got better 
grades. Overall, this last criterion (better grades) and the first (ease of 
lessons) drew the least certain responses from students, with the total 



mean 



* The Learning Environment Inventory (LEI) measures 15 dlnensions, eight of 
which were relevant for assessing impact on student attitudes. Four dimen- 
sions are included in the My Class Inventory (MCI). Each'^is defined: 
Competitiveness— Students compete to se.e who can do the best work; Satisfac- 
tion— Students enjoy their clac.3 work; Difficulty— The work of the class is 
difficult; Friction— There are tiensions among certain groups of students 
that tend to interfere with class activities; Disorganization — The class is 
disorganized; Apathy — Failure of the class would mean little to individual 
members; Favoritism — Certain students are favored more than the rest; 
Environment — The books and equipment students need or want are easily 
available to them in Lhe classroom. 

Students answered zhe LEI Mmes using a four-point scale ranging from 1.00 
(strongly disagree) to 4.00 (strongly agree). The higher the score, the 
higher the , agreement with the dimension being measured. MCI respo-^ses were 
"yes" or "no" and class percentages of agreement arc reported. High agree- 
ment is desirable for satisfaction and environment; for all other dimensions 
except competitiveness low scores are desirable. Competition may or may not 
be considered desirable depending on the philosophy of the school. 
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'Table 59 

Student Attitudes ((luestlonnalre): All Hndels 1982-83 



Mean responses range from 1.00 (not at all) to 5.00 (yes a lot). The higher 



Models 


Active Teaching 


Nastery 


.earning 


Student Teaii learnine 




\ LEAs 


" Cecil 


St. Hary's 


Allegany 


Carroll 


Baltimore County 


Dorchester County 


Worcester Countv 


Total 


Dimensions . Grades 


(K-3) 


(4-8) 


(9-12) ' 


(K-12) 


' (6-8^ 


(3) 


(5-8) 


(3) 




(1) 


(2) 






U'app. 3] 


Hpp. 810 


H22 


N»300 


1)»I48 


N»27 


N«app. 170 


N«app. 165 


Npp. 600 


N''35 




1*2731 


I Recognition of differences 


4.68 

% 


3.83 


3.91 


3.29 


4.53 


4.04 


3.82 


4.68 


4.36 


4.54 


5.00 


4.02 


2. Understanding of lessons 


4.36 


4.50 


4.23 


4.19: 


4.64 


4.93 


4.60 


4.66 


4.66 


4,48 


4.71 


4.65 


3.. Enjoyraent of lessons 


4.08 


3.91 


3.88 


4.09 


4.33 


4.59 


4.32 


' 4.31 


4.52 


4.15 


4.76 


4.45 


4.. Ease of lessons 


3.13 


3.71 


3.49 


3.53 


3.97 


4.44 


4.04 


, 3.92 


3.68 


4.71 


4./6 


3.84 


5. learning of lessons 


4,46 


4.22 


3.93 


3.67 ! 


3,97 


4.44 


3.97 


4.43 


4.26 


4.12 


4.65 


'4.26 


fi. Better erades 


4.39. 


3.75 


3.36 


Ji/1 


J./o 


4.07 


3.70 


3.95 


3.67 


3.70 


4.71 


3,78' 


1< Better lessons 

1 


4.03 


3.96 


3.75 


3.81 ; 

1 


3.98 


4.74 


4.11 


4.16 

_i 


4.30 


4.02 


4.41 


4.26 



le score, the higher the agreement with the 



luension measured. 



Table 60 



Student Attitudes ( learning Environment Inventory ) i STL and E, 1982-83 



Dimensions* 






Populations 


• 




National 
Test Norms 


Charles 
STL 


Annp ATimrlol 

nunc niuiivivl 

ML 


Baltimore City 
ML 


Total 
STL & ML 




X 


Control 
N=50 


X 

N=50 


X - Post 
N=79 


X - Post 
N-61 


N=190 


-.1. Competitiveness 


2.43 


2.51 


2.58 


2.53 


2.76 


■ '2.62 


2. Satisfaction 


2.40 


2.48 


2.56 


2.36 


2.52 


2.46 


3. Difficulty 


2.67 


2.51 


2.55 


2.61 


2.07 


'2.42 


4. Friction 


, 2.40 


2.74 


-2.66 


•2.67 


2.73 


2.69 


5. Disorganization 


2.35 


2.48 


2.37 


2.44 


2.26 \ 


• 2.36 


6. Apathy 

1 


2.54 


2.51 


.2.47 , 


9 Aft 


" 2.47 ,„ ' 


2.47 


7. Favoritism 


2.03 


2.54 


2.21 


2.07 


2.32 


, 2.19 


•8. Environment 

if 


2.40 


2.80 


2.82 


2.82 


2.49 


2.71 \ 

\ 



lEI - Mean responses ranged from 1.00 (strongly disagree) to 4.00 (strongly agree). The higher the" 
score, the higher the agreement with the dimension measured. 

.National test norms were based on 1,048 subjects in 65 classes in a variety of subject areas during 



Higher scores are desirable for satisfaction and environment; for all other dimensions except 
competitiveness, low scores are desirable. Competitiveness may or may not be considered desirable 
depending up^n the philosophy of the school. 



Table 61 



Student Attitudes (My Class Inventory): AT and E, 1982-83 ' 



LEA 



Dimensions 



1« Competitiveness 

2. Satisfaction 

3. Difficulty 

4. Friction 



Caroline - AT 



_Pre N=S24 
I Yes I I No 



75 
68 
38 
69 



Post N=573 



I Yes 



25 
32 
62 
31 ■ 



70 
65 
36 
65 



I No 



30 
35 
64 
35 



Worcester - ML* 


Pre H 


Post 




I Yes 


I No 


I Yes 


t No 


75 


25 


68 


32 


=89 


11. . 


68 


32 


U 


86 


38 


/■ 62 


44 


56 


56 

1 


44 



While pre and post tests in Caroline and post tests in Worcester were completed 
by students, pre tests in Worcester were completed by teachers who predicted 
student post test responses. 
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on those items pulled down by responses from older students (grades 4^12) 

possibly because they are more discriminating than younger students. In 
general, mean scores for STL were higher than for the other two models. Given 
the nature of tike model, higher scores might be expected for "enjoyment of * the 
lessons" since! timst students like working in groups. Other responses (in 
comparison to ATsAnd ML) may have been influenced by that enjoyment and also 
by the fact that more STL students were younger. No overall means or item 
means per respondent group were lower than 3.36 (better grades). The two 
iten5|most related to project impact (better grades and better lessons) drew . 
mean responses of 3.70 and 4.02. respectively, which indicate project success 
as perceived by students. 

Results of the LEI indicate that the means for each project and across 
the three projects were better than national norms on four dimensions: satis- 
faction, difficulty, apathy, and environment. There was room for improvement 
in relation to friction, disorganization (except in Baltimore City) , and 
favoritism. Results of the MCI indicate room for improvement in relation to 

friction. There were no significant differences between models, regardless of 

\ 

the fact that STL Is designed to reduce friction and avoid favoritismX 

Cognitive achievement data from standardized mathematics tests were \^ 
reported by four projects — one .,in AT and three in ML. In -all cases, gains 
were greater than normally expected, with most significant improvement found 
for low or middle achieving students. At one project site, standard deviation 
narrowed and the year's growth was four months (grade equivalent, CAT) greater 
than expected. Eight projects reported databased on teacher-made criterion- 
referenced tests (AT=2, ML=4, STL=2) . In most cases, SITIP students did 
better than students in "regular" classes, with gains made most consistently 
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by below average students. Data supported claims for ML that at least 80% of 
the students achieved mastery (established at 80% or more of the course 
objectives mastered). 

These results support developers' claims for AT, ML, and STL. However, 
direct cause-and-ef f ect conclusions should be made with caution, attending to 
the nature and extent of implementation relating to a given set of results. 
Participant Concerns and Recommendations* 

Concerns were reported by participants of all projects, and were 
categorized as being related to the model(s) or to the general process of 
implementation. (See Table 62.) Most model-specif ic concerns related to 
management — the need for^ time and materials for effective implementation. 
Many concerns related to consequences — the impact on- particular kinds of 
students, on curriculum, and on discipline and the assessment of that impact. 
Teacher concerns are also consequential, with some personal overtones.^ 
Concerns about the design and 'sbSi^"bf^the^ssesslnen^^cb related to 

refocusing — a dissatisfaction with the model as implemented and a desire to 
do something different. General implementation concerns were reported for 
three models (there were none for STL). All of them related to management, 
with some personal or consequential overtones. These results are what might 
be expected given the age(s) of the projects. f / 



* In the 1982 report, concerns were analyzed using the Stages of Concern, (SoC^ 
developed by the ^Center for Teacher Effectiveness at the University of 
Texas). In general terms, that same framework is used here. Str^jfis are 
roughly developmental (Awareness, Information, Personal, Management, 
Consequences, Collaboration, Refocusing) as an individual or group learns 
about an innovation, uses it, and fits it into existing activities. / 
Concerns in earlier stages need to be satisfactorily addressed before 
participants can be expected to move to another^ phase of activity. 
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Table 62 



Participant Concerns: All Models, 1982-83 







Models 




Concerns 


AT 


ML 


STL 


TV 


Model Concerns 










Time 


— allocations too rigid 

reQuires too much rsmrH-VAoni no/ 
paperwork 

— requires too much student testing 
L c:4u & CO tuu mucn in general 

— requires too much preparation/scoring 


A 


1 
1 

7 


2 

3 
A 


3 


Materials 


— need enrichment activities 

need materials rhnr t pa ^••«'«'4Miiiii.n 
tiKi L X n LiiaL Lit If curriculum 




2 


I 




Students 


— holds back talented Ss 

— remedial Ss go off task 
wccx^ axi aepena on Strong SS 

— absentees hard to handle 

— grouping is difficult 


I 


5 
I 


2 
1' 
I 
I 




Discipline 


less r^flphi*!' pnnr^rti m/s^aK 

A 1=0 0 bca^iic L LiUnurux, more noi se 






2 




Curriculum 


— does not fit all subjects/grades 

— coverage is reduced 


A 


, 2 
1 






Teachers 


— creativity is inhibited 

— observation creates fear, pressure 
model more ?iseful for new teachers 


o 






2 
1 


Assessment 


— achievement is difficult to measure 

— point system (bumping) is not popular 

— checking should not be done by Ss 


' 2 




1 
2 




Design 


lack of research base 

— complex, difficult to implement 

— coding categories are judgmental 








1 
2 
2 


Implementation Concerns 










^ Insufficient time 
Insufficient central office support 
Poor coordination (model, materials, management) 
People and resources not used to meet project needs 
Inflexible budget process 
Unclear evaluation guidelines 
No monitoring of observers 
Leaving class to teacher substitutes 
Poor communication — teachers don't know why model 
is used 

Poor attitude/teacher apathy 

Teachers not engaging students in learning 


3, 
5 

1 

- 


2 

< 

1 
1 




2 
1 

1 
1 

1 
1 



. N-number of LEAs implfementing a given model. 
vlrlabJes/'""''""^' ^tL-Ma8tery Learning; STL-Studant Team Learning: TV-Teaching 
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Recommendations were made by participants of all projects, and were 
categorized into six general areas: learning, teachers, classroom use, imple- 
mentation process, interactive support, and expansion/revision. (See Table 
63.) Learning recommendations related to the SoC '^information" stage, and 
reflected a cycling of sophistication and appreciation for on-going training 
and assistance: participants have learned and want to continue learning — 
sometimes in a particular way or in a particular area of expertise. Recommen- 
dations for teachers related to the "personal" SoC stage and indicate that in 
some cases there is fear, resentment, or confusion that needs to be overcome. 
(ML, STL, TV). Classroom use and implementation process recommendations 
related to two levels of management, and indicate that local impiementers have 

a 

become sufficiently familiar with the models to identify (and want to over- 
come) barriers to successful use. The AT recommendation for situational 
adaptation suggests a need to clarify understanding of the model how it is 
explained, and how ..it is implemented). There are fewer management recommenda- 
tions for STL than for other models, which is somewhat surprising given the 
number of concerns about time and students. Recommendations classified as 
"management" were influenced by iritereGt in consequences. The "collaboration" 
stage related to what others are doing — - interactive support — and most 
recommendations in this ^ group indicate that school-based staff are not ready 
to take full responsibility for implementation (and perhaps should not be 
expected to do so). Recommendations about expansion or revision related to 
the refocusing stage, and mostly indicate that local educators value the 
models enough to want expansion (although opinions are divided for ""V between 
expansion and termination and reflect concerns about the design and the way 
some teachers in some LEAs react to it). 

\ ■ . ■ ■ ^ ^ ' ' 
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Table 63 

r ^ 

Participant Recommendations: All Models, 1982-83 



Recommendations 



Models 


A T 


ML 


STL 


TV j 




N-7 


N-8 


N-6 


A 




2 


2 


1 


I 










1 






3 


1 










I 






1 








2 






2 


2 


I 

I 








1 




2 






. 3 








Z 








J 






I 


1 




1 






1 






2 


1 








1 






I 








I 


5 


1 


2 








I 








I 








I 


1 


2 


] 




1 


2 


1 


I 


1 






I 


1 










1 


1 










2 






1 






2 












3 


6 


6 


6 


3 


2 ' 








1 








3 














2 



t.earning 



Teachers 



Classroom 
Use 



Implementation 
Process 



Interactive 
Support 



Expansion 
Revision 



provide training and follow-up assistance 

- provide research updates on school improvement 

teacher effectiveness ' 

- provide research results before implementation 

- encourage. teachers to increase knowledge & skill 

- provide more specific instructional improvement 

ideas 

- allocate resources for classroom observation 

- reduce burden on Ts 

~ have only voluntary participation (it's not for 
every T) 

- help Ts see value of model 

- compensate Ts for after school activities 

- allow situational adaption 

- maintain fidelity (and monitor) 

- allocate/adjust use of time 

- provide materials 

- sequence units more carefully 

- have ability grouping/small er classes 

- develop record-keeping system (computerized) 

- develop strategies to deal with absentees 

- allocate time (development, paperwork, 

preparation 
" assign new leadership 

■ do not add model on top of LEA priority 

^ do not begin in first few days of semester 
" use earlier in the year 

■ evaluate effectiveness 

' increase funding 

■ increase central office support 

■ increase MSDE/central office cooperation to 

help Ts solve problems 
increase MSDE assistance 

encourage more networking among and within LEAs 

provide or develop materials 

involve more Ts in curriculum development 

drop the program 

increase involvement .schools/grades/subiects 

try another toodel 

use every day 

use for the full year 

use another part/technique of model 



N-numbei- ofvLEAs implementing a given model. 
AT.Acttve Teaching; ML-Mastery Learning; STL-Student Team Learning; TV-Teaching Variables. 
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If a project is to succeed (if SITIP is to be successful), concerns and 
recommendations should be addressed by MSDE TAs and LEA teams. For AT, the 
most critical issue is local perceptions of the fit of the model to specific 
grades, subjects, or students (as grouped). For ML, the most critical issue 
is cost-effectiveness in terms of time allocated for unit and test develop-- 
ment, and the subsequent Mcord-keeping, in relation to the perceived value of 
the model. For STL, the>ost critical issue is cost-effectiveness in terms of 
teachers' investment in relation to impact (including discipline) on various 
kinds of students. For TV, the most critical issue is the perceptions ~ 
fear, apathy, resentmeut (primarily of teachers) —.about local" implementation 
decisions and about the model ^design. While those issues suggest negative 
Impact in some sites, it should be noted that they are not pervasive and do 
not out-weigh the positive impacts reported earlier. 
Coifeluslons 

While processes of implementation based on the research on planned change 
were recommended for all models in all LEAs, and TAs encouraged local educa- 
tors to attend to such principles as participatory decision-making, two-way 
communication, training and support, and appropriate investment of time and 
energy, those processes of implementation' and principles were not always ^ 
applied.* When they w?re applied, implementation, went sufficiently smoothly 
for energy to move gradually from establishing structures, relationships, and 
expectations toward actual classroom use. When there were arbitrary adminis- 
trative decisions, top-down or incomplete communication, low. support by 
central office staff, and insufficient time allocated for materials develop- 
ment or group planning by teachers, implementation problems occurred. 

* In some cases, the responsibility f or ,the low level of application was 
shared with the assigned TA. In other cases, the TA»s~ efforts were 
disregarded by local staff. 
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At the local level, these principles or practices were generally referred 
to as interactive .'support, and, depending on the nature and extent to which 
they were applied, had positive impact or created barriers to success. (See 
Table 64.) 

o 

Impact was made on student achievement by three models (AT, ML, STL), 
with the strongest evidence of success in raat hematics and reading/language 
arts for AT and ML. Positive results were most apparent when either of those 
models was used consistently over a period of time for a given subject and 
grade. 

Impact was made on student attitudes to some extent for all models. Data 
summarized by 12 projects (AT, ML, STL) indicated .that SITIP students enjoyed 
the lessons, did not find them difficult, and wanted to succeed. Friction 
among students, and their- perception of favoritism and disorganization needed 
to be addressed .at some sites. While teachers believed that for STL students 
self-esteem and willingness to work with others increased, student* data . for 

i \ -V 

STL indicated no differences f\)r that model in comparison to AT or ML. 

Impact was made on teachers\ knowledge for all models through training. 
Skills in a new teaching/observatii^n technique increased through classroom 

\ . • 

practice and coaching. Positive attitudes about teaching were strengthened as 
teachers experienced success. 

Impact was made on a school (the faculty and how instructional matters 
were dealt with) through commitment and sharing among teachers (ML, STL, TV), 
and provision of support (ML) and recognition of success (STL) by school 
adrainistrators (usually the principal). Staff interest in teaching 'learning 
increased (AT, STL): there was more continuity across classes (AT); better 
management of instruction (TV); and closer monitoring of teaching (AT). 
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Table 64 



Barriers and Facilitators to Successful Implementation 



0 

i 

Barriers ' 


T— ■ . ! _ / 

Facilitators / 


Heavy reliance on training (ML, STL) 
Insufficient resources for training (STL) 
No follow-up assistance (STL) 


Training and assistance responsive to Ts' 
expressed needs (AT, ML, SJIffrv) 


Raiionea resourcas, broad developiiient (ML) 


T time & skill to develop materials (AT, ,ML, 
STL) ■' ' ■ 

Resources allocated for development 


T adapt model (STL) 

T perceive no credibility of model (TV) 


Fidelity understood, advocated, & acknowledged 
by SA & CO (AT, ML, STL) 


CO maintain administrative, control, but expect 
work to be done by school staff without building 
ownership (AT, ML) 


CO demonstrate interest in' project success. (AT, 
ML, STL, TV) and acknowledge T efforts (AT, 
STL) CO act to overcome problems (AT) 


Plane nvoflxr ■jmK'l f> •( ■ n / ptt \ 

ijidiib overjLy amoitlous [olL) 

Plans not .followed by project leaders (STL) 

Purpose not clarified, mutually understood (TV) 

— H ^.^^ 


Shared planning, purpose setting, decision- 
making (ML, TV) 
Networking encouraged (ML, TV) 
SA fit model to school priority (TV) 


Ts perceive their efforts are devalued (MI.) 


Ts believe their opinions and efforts count 
(ML, TV) 

Ts believe project is designed, for improvement 
(TV) 

Ts value recommendations of observers (TV) 
SA emphasizes professional development (TV) 


Single energizer with low influence (AT) 
Confllctin;- messages (CO, SA, some MSDE) , (ML, 
STL) 





1 

J^T=Active Teaching; ML^Mastery Learning; STL=Student Team Learning; TV=Teaching Variables. 
Cp=central office staff; SA«school administrators; T=teachersi 



Impact was made on school administrators' knowledge for all models 
through training, and they improved instructional management (AT), 
strengthened their belief in traditional teaching (AT), and were more appre- 
ciative of teachers' capability (AT, ML) as implementation occurred- in their 
schools. 

Impact was made on central office staff's knowledge for all models 
through training, -and, for AT, they improved instructional management as they 
became involved in implementation. 

At the system level, there was knowledge gain (STL), cross-hierarchical 
sharing and commitment (AT, ML), and policies enacted to release teachers to 
train others or coordinate activities (ML), and to implement the model 
district-wide for a given subject or grade level (AT). 

As stated earlier, the implementation strategy used influenced impact 
(with capacity-building being the least effective). Another strong influence 
was the relationship between a model and jlocal priorities (as perceived by 
local educators). Probably the strongest influence on successful implementa- 
tion was interactive support: while teachers can and do teach alone in their 
own classrooms, they do much better when their efforts and successes are 
acknowledged and they are part of a cross-hierarchical team working toward 
instructional improvement which benefits students. 




VI. SUMMARY AND CONCLUSIONS 

During the 1982-83 school year the Maryland State Department of Education 
continued to support local implementation of fou?: research-based models of 
instructional improvement. Impact on educators at all hierarchical levels was 
assessed by various methods. Attention was paid to initiatives of MSDE 
(p.lanning, training, and assistance) and to local implementation. The final 

sectioas of Chapters IV and V summarize state and local efforts respectively. 

\ 

Here, a brief overall summary is presented. \ 

V 

Application of the research on planned change facilitated imi^lementation 
of models of instructional improvement. The SITIP design encouraged collabo- 
ration, increased communication using a common knowledge base about' school and 
classroom effectiveness, and helped LEAs establish cross-hierarchical teams 
with the purpose of improving instruction. Unless the principles of planned 
change were applied, the model adopted had little chance If success. 

The models themselves were perceived by local educators as having both 
subjective and objective value. Teachers' positive opinions had just as much 
influence as standardized test data in determining program maintenance or 
expansion. Teachers' negative opinions or concerns had a little influence in 
determining maintenance or expansion and did influence the relative impact of 
the project. 

Active Teaching and Masterj^ Learning, when implemented with fidelity for 
a complete course, had a positive impact on student achievement, and helped 
teachers to organize instruction effectively. The models were valued more by 
teachers when used for structured academic curricula than for more open-ended 
subject areas.. Mastery Learning required consifeable administrative support. 
Both models were more successful when administrators acknowledged teachers' 
efforts. 
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student Team Learning was popular with students and teachers and had a 
positive Impact cn achievement In some cases. However, It was not used 
consistently, and so cause-and-ef f ect claims cannot be verified. Maintenance 
and expansion ^ ally occured when teachers saw the value of the model, and 
appropriate materials. were available. 

\ Teaching Variable^ was used as a professional development process (and 
was then more likely to be valued by participants), or as part of a supervi- 
sion process , (and was then more likely ta be viewed with suspicion by 
teachers). Little evidence was provided to indicate impact on student 
achievement, but there were some re^ports of teachers improving their manage- 
ment of instruction. 

Key staff in all LEAs, in 11% of Maryland's schools, in colleges of 
education, and at MSDE increased their understanding of recent research on 
planned change and school and classroom effectiveness. Nearly 1000 teachers 
modified their insWuctional techniques, and most of them believe that the 
results ^re worthwhile. The general attitude of all role groups involved in 
SITIP was positive, \with appreciation f or the opportunities for professional 
growth, and for the benefits to students receiving improved instruction. 

During the 1983^84 school year, local implementation will continue to be 
supported by. MSDE, with attention to participant concerns and recommendations 
and to the results reported here. ^ SITIP advocates hope that LEAs will make 
purposeful data-based decisions — either to terminate or to institutionalize, 
preferably the latter with local commitment to biiild on the state initiative. 
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